Based on the information you were given, ("thats him right there") and his demeanor I'd say you were fully justified how you handled things.
I would probably have lessened my explanation to him and just pointed out that someone behaving that way toward an LEO is going to have a weapon unholstered, good intentions or not.
You just DON'T do that sort of thing around armed individuals...