People who obsess over group size will probably be disappointed no matter how much effort they put into it.
Yup. Raw accuracy is important, but other qualities are important in the field as well, sometimes more important. My accuracy requirement for a hunting rifle is that it's able to put the first shot in the sticking spot, not that it makes pretty benchrest targets to hang on the wall.
