Good on you. I call them bands around the buttstock shell losers.
I quit using them years ago for the same reason.
One neat story, I was hunting with my Model 70 280 Rem one year with several rounds in the butt stock band. Naturally, lost one round during a hunt. Was hunting the same spot with the same rifle the next year and found the lost round laying off to the side of a trail. Never thought I would find any of those rounds I lost.
