"By that logic, anyone could be searched at ay time, because how are police to know if anyone has weapon in their pocket?"
Yeah, that's certainly the case. The courts have NEVER EVER ONCE IN OVER 200 YEARS drawn a distinction between what is visually observable
and what is not.
That's why the police are, at this very moment, digging around under the seats of your car looking for hidden contraband.