I've actually had better luck, accuracy-wise, with #3s. I've only had four number 1#s, certainly not a representative number and all of mine were older models, all purchased new but one. Got rid of the last one a number of year ago. While I got occasional good groups with all these rifles, it was never consistent (as with a good bolt-action) and three of the rifles wouldn't hold a zero for any great length of time.
Gunwriter and former Ruger employee (in the 80s, I think) C.E. Harris commented that a Ruger #1 that would consistently shoot 1 1/2" groups was a good one. I'd have to agree. I understand they shoot much better now, but I doubt I'd try another unless it was a steal. As for looks, can't beat a #1.
