If you think that one male, even an unarmed one, can't be a deadly threat to you then you are completely wrong.
Your opponent might knock you out with one blow....and then proceed to kick and stomp you to death.
While this is always a possible but are we to draw our firearms every time there is an physical altercation? I have been on the receiving end of a few road rage incidences where I live to include someone exiting their vehicle wanting to fight...would this justify me drawing my weapon? I bet not, hence why I am not dead or in jail.