You said that this is your first semi-automatic pistol.
You might consider that this is not a problem with the weapon but that it could be a technique problem on your part.
http://en.wikipedia.org/wiki/Limp_wristing
Might not be, but it is worth looking at.