whenever anyone (besides a woman) approaches me for anything my anxiety goes way up.
That sounds like an awful way to live. My awareness might go up when people approach me, but I'm not going to be fingering my gun handle every time someone asks me for directions. Constant fear and gun ownership sounds like a recipe for mistakes.
I do carry, and I keep one in the chamber for instances just like this, but I'm not going to live my life in fear just because something might happen.
That being said, I probably would have handled a drunk/crackhead leaning on my car a bit more aggressively.
I'm glad everything worked out for the would be victim.