I see you added more to your post.
Irrational fear is often the basis for banning or restricting things, and your case seems to be similar.
There aren't many incidents where body armor is a factor. Wearing body armor certainly doesn't make you invincible ether. It still hurts like hell to get shot. Most of the time there is a good portion of the wearers body unarmored also.
If you are worried about people wearing armor so much then train to shoot low center of mass in the pelvic area or the head.
If you are so worried about it go buy your own armor and wear it all the time.
Then you will be even.