No- -it's like wiping your ass before pulling up your pants. Lots of neck bushings in sizer dies aren't that hard, and get scored easily. Lots of chambers and reloads have close tolerances, and not wondering if the fit is tight because your die is set up wrong, or if you still have too much gunk on your brass makes ckleaning before reloading a perfect time to do it
