Check the barrel's fit to the stock fore end. There may be a really hard contact point someplace on the right side of the barrel against the fore end.
US Navy Distinguished Marksman Badge 153
Former USA Palma Team Member
NRA High Power Long Range High Master
NRA Smallbore Prone Master