I say you have voiced perfectly what I have been thinking this past few months. Shooting rimfire is fun but being able to mess with my rifles, load rounds and develop a special load for each rifle I shoot is much more enjoyable to me.
The 100 yard accuracy gain is the icing on the cake.