"anyone else have that issue sometimes?"
Nope. Never. Ol' Pet was set up to shoot anything I was likely to hunt, anywhere out to 500 yards. Weatherby Mark V, .06, 26" barrel, Canjar trigger, Leupold Vari-X II 3x9x40. Reliably sub-MOA. Generally, 150-grain Sierra SPBT ahead of 4064.
You're from BATFE? Come right in! I use all your fine products!