I am in the camp of "the smaller lighter gun will be on you more often." My pocket gun is a semi auto that is on the top end of size, and weight that I will pocket carry. It goes with me everywhere I can legally carry. Even when it is hot, and I am wearing light weight clothing.
No matter how many times you do it and nothing happens it only takes something going wrong one time to kill you.