Here is another method of easily removing rust. Make up a very-very stong batch of tea. I buy the cheapest tea bags I can find in the grocery store and throw a bunch of them in boiling water. Put the item in the tea brew (after taking it off the heat) and let sit over night. Remove it, wipe it off and add a light application of oil.
Warning: Don't drink the left over tea.