Should be plenty, but suggest you load up some heavier stuff. Why have a .308 caliber and shoot lite bullets?
I like to use at least 180gr. bullets on elk, but with that said, I shot my cow this year with a 100gr. Sierra out of my .243!
Anyhow, 165 gr. will work fine if that is what you decide on.