Damage to your hearing is not limited to gunfire.
Never shoot without hearing protection if at all possible. Never. This is especially true of shooting handguns. I do on occasion shoot 22 rifles without protection. But I know better. You will pay a price over time. For some, the perceived damage is immediate, and for others you will just gradually loose your hearing.
Do not work around heavy equipment that produces a high pitched noise without protection.