In my CHL class here in Tx the instructor put it this way:
If it is a single, unarmed attacker you may not draw.
If it is a single, armed attacker you may draw.
If it is multiple attackers, armed nor not, you may draw.
FWIW, the rules for drawing and the rules for firing are one and the same.