Several variables besides the scope's.
If you hunt in early morning or late afternoon, the bigger lens helps in dim light. Mid-day and summer, it's less help--plenty of light, and shimmer at higher power.
If you figure you'll shoot from a sitting position or with some handi-rest, the higher powers can make things more "wiggly". If you make a portable bench and hunt from near your vehicle--prairie dogs come to mind--you can readily use the higher-power scopes.
The .22-250 can really reach out, so for a rifle dedicated to varmints I think I'd go with a 4X14 or whatever is close to that. There is no law that says you just HAVE to set it to its highest power, and on small stuff like feral cats at 350 or 400, the extra magnification just might help.
Hope this helps, Art