The Kydex should hold up just fine from normal wear.
Of course, if you bump into something without a gun in the holster... it could definitely break the kydex shell.
Fortunately the stuff is cheap and you should be able to replace the shell if that ever happened.