There's a big difference between "people like you ought to be shot" and "I'm going to shoot you." The former is a tactless opinion; the latter is reason for very real concern.
I'd have walked away given the choice. That said, we don't know what happened, so all we can do is speculate.
Sometimes it’s nice not to destroy the world for a change.