I can't read the numbers on the digital clock without my lenses. I wear contacts during the day, and at night about an hour before bed I switch to glasses.
When I wake up I instinctivley reach for the glasses. We recently had an alarm activation at 4 AM, and it was muscle memory.
You WILL get use to it if you do it enough.