I only neck size, and don't ever FL size rifle brass any more. If you use the Lee Collet die and segregate brass according to the rifle it is fired in there should be no need. Brass needing to be FL sized to "bump the shoulder back" indicates an issue with the way you are sizing - it will come out of the chamber slightly smaller than the chamber, so if it won't go back in that is usually due to something you did in the reloading process.
The reasons I prefer neck sizing are not confined to accuracy. There's less working of the brass, and less likelihood of case head separations.
I have brass which has gone through literally dozens of loading cycles without ever being FL sized. It does get regular neck annealing. Case life appears to be limited by primer pockets not staying tight (not much of a problem if you don't try to load too hot), neck cracks from not neck annealing often enough, and losing cases in the field.
