You're almost certainly reacting to the recoil. (That doesn't mean you don't
enjoy the recoil -- you might. Some folks do, but still react to it in ways that affect their accuracy.)
Try the tips in this article:
http://www.corneredcat.com/article/t...cure-a-flinch/
pax