I'm still anal enough that I usually clean primer pockets, but the only cleaning the flash hole gets is the small Allen wrench that gets poked in it to make sure the media from my vibratory cleaner is not plugging it.
If you leave your decaping pin in your sizing die, it will take care of that for you when you size and save yourself that step of poking with the Allen key.
