Your 308 will be fine for elk, just use a good quality 180 grn bullet.
I use a 270 Win my self.
Its your favorite, meaning the chances are you shoot it fairly well, which gives you a leg up on those flinching away with one of those super duty shoulder busting magnums.
CPT USAR Ret
USAMU Sniper School Oct '78
Distinguished Rifle Badge 1071