I'm sorry for not being clear. It's not the brass that needs polishing but the extractor should be examined. I don't have a Remington out but if you compare your photo with jmr40's you can see how much further your extractor projects toward the center. It may need some setting back and polishing.
Vigilantibus et non dormientibus jura subveniunt. Molon Labe!