50 years of reloading I only clean cases when they have visible dirt on them, I do clean all primer pockets with a primer hole cleaner,

when you tumble brass it takes some of the brass off especially if you use metal such as stainless pins ( I believe that ) the brass becomes thinner.