That is very, VERY unlikey, and not worth pulling a weapon over.
It is not the likelyhood of an attack that causes me to Carry, but the stakes involved: all you have and ever will be. Dead is Forever.
If you don't think your life is worth pulling a gun over, fine: it's yours to value, or not, as you see fit.
Not only can one punch be fatal, what, exactly, other than his "good character" would stop someone that would punch you for appearing worried he might hit your door from stopping after one punch? Why nothing at all: he could just as easily beat you down and curb stomp you.
Trust Goblins to exhibit reasonable behavior at your peril, Sir.