Eldorado, That is where folks make a pretty common mistake. By this I mean the perception of less damage, is not the same thing as no damage. Fact is, you are still damaging your hearing...permanently.
An example I see a lot is with 22 rifles. Just cuz' it no longer hurts, it is common to see the shooter, often older, failing to use the hearing protection he uses with his centerfires or shotgun. This lack of pain hides the fact that you are continuing to contribute to the damage...permanently.