Is it a new rifle or one you've had? How far were your targets? I start out at 25yds punch cloverleafs from a bench. Then move out to a hundred have found with my Rifle, a Tennessee Mt. (Miroku), that at 100yds that POA & POI is the same at 25yds. Using home made Lee .490 R.B, 60gr of ffg, pillow ticking and Mooses' Milk...Have you ever tried Lee Maxi Balls alot heavier, sold my scale no way to way them conical solid base, lube rings no patch. With Bore Butter they'll slide down all day.. I know I'd hate to be in the way of one.
Anyway, that's quit a variation on the Hornady balls. Patches aren't tearin. burnin', crown's ok? Jus' a thought. Could try Speer Balls.