Have you soaked it in penetrating oil of some description?

Won't break the taper but will definitely help any rust that has formed thats further impeding.