SGTLUMPY got it right. I visit Waco, TX often and there are A LOT of homeless there. Several years ago I decided that if someone was obviously walking toward me (not passing me walking to or from the restaurant or store entrance) but someone who has made eye contact or whose body language indicates that they have keyed in on me; I will in no uncertain terms tell the them that they are close enough and to stop, look for an escape route and get ready to draw if needed. I have had to do it several times. So you might hurt someone's feelings who were harmless, boohoo for them.
"Suppose you were an idiot, and suppose you were a member of Congress, but I repeat myself." Mark Twain