Sure times have absolutely changed. The fact of the matter is the op called out to the person on the other side of the door and they didn't respond. That, coupled with his constant looking away from the door would have put me on edge too. If his intentions were good, why not answer?
Maybe he didn't mean any harm. Maybe he did. Until all the facts are in I think its better to err on the side of caution.
And to the op, let me be another to drive this point home: when you get home put the gun on your belt and leave it there til you go to bed.