Check the barrel's fit to the stock fore end. There may be a really hard contact point someplace on the right side of the barrel against the fore end.
US Navy Distinguished Marksman Badge 153
Former US Navy & Palma Rifle Team Member
NRA High Power Master & Long Range High Master
NRA Smallbore Prone Master