I finally beat it by drilling out the centre of the shaft with a 17 mm drill bit. That allowed me to drive out the shaft because the resultant thin wall of the shaft offered less resistance. Thanks everybody for the helpful suggestions. Now to make the roller ends!