Well... they are ruined anyhow... so hurting them more won't hurt them..
They are either staked in (original Colt style) or are locktited in. First thing to do is to figure out which methind they used.
Loctite: Heat with a torch to soften, and unscrew them with a (hate to say it) set of vise grips, if you do not have the correct size EZ-Out to use.
Staked in: This will be tougher, you will end up drilling them out.
Before we go there, figure out how they are attached to the frame. The others you removed ought to give you some clues.