Lot of folks do that but I never have. The most important thing about shooting lead bullets is fit and that includes paper patch. Too much sizing will hurt accuracy as will too much paper. Get yourself a copy of Paul Matthews' book "The Paper Jacket". It isn't the last word but it is an excellent primer.