I feel that 9mm is adequate especially if you have loads that are high energy such as Corbon 9mm 90 or 100 grain +P. Go to +P+ and you really have some wicked rounds.
I plan to get a 40 to have experiences with. I have a Sigma 9 so I'll get a Sigma 40.