Start looking for problems such as barrel not free floating ,receiver needs glass bedding etc.WHAT'S THE TWIST RATE ??
Remember that cartridge is noted for being accurate. It's still being used as a sniper rifle IIRC, Reminton once made their target rifle in that cartridge.
It really should be easy to get nice groups.
And Watson , bring your revolver !