Long time Glock user here, I understand your concern (used to have concerns myself!).
Don your carry holster (no pun intended), triple-check that your Glock is UNLOADED/no magazine/ammo in another room, etc. Spend a few hours unholstering/reholstering the empty pistol. If you hear the trigger "click", something is amiss.
My bet is that you won't ever hear that "click".....and your mind will be eased.