Are you sure it's the leather?...just kidding
You might try a product called Lexol leather conditioner. You can usually find it at places that sell tack and some shoe shops carry it.
I don't like my pager pal, it digs when I sit, and I don't like to wear thin belts. Do you like yours?