Well, take that attitude and you will just use open sights. Good enough, cheaper than the cheapest scope.

Then when you start using optics because it gives you an advantage are you supposed to just ignore the differences though small they might be.

The single biggest advance in accuracy over open sights is having crosshairs to aim with. A good 2.5x scope or even a 1x would do that. All the rest are smaller improvements in the ability to hit a target.