I do it on all my competition guns, including the front and rear sights. I had a front sight on a G34 loosen up just enough it rotated, not enough be obvious, but enough to shift the group about 6" right at 10 yards - enough to miss plates on a rack.
