Pulling Spindle....

I need to pull the spindle on my BP clone. I *think* this is supposed to be as simple as un-doing a set-screw on the back of the quill, removing the "cap" from the bottom end of the quill, then just pushing the spindle out. Is this correct, or is there more to it? How hard is it to tap it out? I tried this once, and couldn't get it to budge.

BTW, if anyone here is interested, I've recently built a 10-tool carousel toolchanger for my machine:


Regards,
Ray L.