Don't use any oil or grease on the outside of your holster! Use only good quality shoe cream/paste. KIWI brand is supposed to be pretty good. Use the neutral wax paste. If you have a black holster, you can just use black. Brown may be a little harder to match, since there are different shades of that.
Basically, take care of it the same way you would do with a really nice pair of shoes.