If it is the kind of stuff I'm thinking of, that Permatex is going to be sort of yucky looking on a rifle, better for tractors.
How about the usual advice of 0000 steel wool and oil, with a light touch? Or bronze wool, or some rough cloth, and oil. Then some Oxpho Blue. Later you can do a complete and proper job.