I shot my Glock once without hearing protection...my ears were ringing for some time (but not as bad as my buddy's who shot his .357 magnum
) And that was only a 9mm! I'm pretty sure you would eventually go deaf if you shoot a high-powered rifle without protection frequently.
I alsways use ear hearing protection when I shoot (and when I go to rock concerts!).