just my opinion/two cents only
don't shoot without earmuffs and plugs of whatever type jointly, but don't worry about your ears for the typical home defense scenario or whatnot. Just don't shoot in a non-selfdefense scenario without the protection.
How many times in your life have you shot without protection? I know I have done it...the first of the very few times was one of the first times I shot, and I did it on purpose which I guess was unnecessary at best.
Save the life threatening, emergency situation(which hopefully never happens) for the time when you have the greenlight. I respect your thoughts and it is a good thread + question, but I wouldn't get rid of my 357s to do what you are considering.
just my advice and you can take it or leave it
"Damn the torpedoes, full speed ahead!" -Admiral Farragut @ Battle of Mobile Bay 05AUG1864