You should need to handle your firearm when you holster it in the morning and when you put it away at night. In between, you shouldn't be messing with it unless you're about to USE it.
I carry a Glock 33 in a Crossbreed Supertuck. It has no retention except for a slight indentation in the kydex that the trigger guard has to slide past. I have no troubles with leaving it in the holster during any normal "activities".
I would not use a holster that required me to remove the firearm during a normal day.
Still happily answering to the call-sign Peetza.
You do not HAVE a soul. You ARE a soul. You HAVE a body.
He is no fool who gives what he can not keep to gain what he can not lose.
-Jim Eliott, paraphrasing Philip Henry.