My dad always used 180 grain for deer. The only time he ever shot 110 grain was when he went antelope hunting back in the '80's I think it was. He sighted in, fired one shot to get his buck, and gave me the rest of the box last year.
I have a box of Hornady 110 grain spire points and a box of Sierra 220 grain RN that I will load at some point just to see how they shoot. The 110's are lower left, 220's upper left. Everything else I have in .30 cal. is 150, 165, and 180 grain (except for the .30-30 which are 150 and 170). As with any other load, try it in your rifle working up from a starting load and see how it does for you.