Late, but maybe for my own edumication....
On a trilogy frame, I was able to grab the left (fire) side with a pair of pliers and twist back and forth while pulling. This let the ball roll up and out and into the sear recess on the safety pin. I thought I was in real trouble there (safety half out with the ball and spring in there), but wiggling it around got everything out in one piece. Are the regular hinge frame safeties the same as the trilogy?
It might have come out cleaner from the other side.