I use an old 6" drill press vise, a short-handled 8 oz hammer and a piece of hexagonal aluminum stock for a drift. For vise jaw padding, I close the vise snug on a folded section of Coke carton and trim to fit. Haven't lost a battle with a dovetailed sight yet; though I have bolted the vise down to a steel table and used a little bigger hammer on occasion. The worst was a Citadel slide with their Novak knock-offs ceracoated in.
The importance of absolutely securing the slide cannot be overstated.