Two against one is enough deadly force by my line of reasoning, even if unarmed. Add to that you were not completely free to defend yourself, you had to defend your daughter as well. Two thugs vs 1 man and a little baby. You avoided them, and they pursued, cursing at you. You did the right thing. The proof was that they ran off. They knew they were up to no good, and so did you, and so do we.
Chalk one up for concealed carry!