It's very easy to scratch the surrounding bluing with Scotchbrite or steel wool. I use this product:
http://www.big45metalcleaner.com/ It's similar to steel wool, except made of an alloy, monel. The monel is harder than rust, but softer than bluing.
Best of luck!