Hmmm... 3 to 4 inches.
I too would wonder if a barrel stabilizer wouldn't help.
I may have missed it in previous posts, but you should try a few different weights and types of ammo.
If there isn't a photo then it never happened.
Gun Log SPC iOS Range Book
If you find your back is up against a wall, maybe you have been backing up for too long.