Whether it shot good or not it would drive me nuts if I knew the barrel was crooked to the receiver.
But that's just me.
If you are handy with a few shop tools there is a fairly simple way you can check the axis of the barrel to that of the receiver via diffraction rings in the bore.
In the simplest form, if you were to wipe the bore clean and insert an unprimed cartridge case into the chamber with the bolt removed and looked into the bore from the muzzle end while aiming the action at a white wall, you would see the image of a target in the bore. What you are seeing are diffraction rings around the axis. A perfectly straight bore would show perfectly concentric rings around the center. The image would form a perfect target. If the axis of the bore were out of whack, you would see it as a distortion of the rings in the bore. The rings, or a single ring, would appear off center.
Now, if you were to take a wooden dowel slightly larger in diameter than the body of the bolt, and drill about a 1/8 inch hole in the center of it, and insert it into the rear bridge of the receiver, and then peered into the bore as before, from the muzzle end, if the axis at the rear of the receiver were out of alignment with the bore, then the diffraction rings would clearly show it.
In order for this to work, you would first have to perform the test with just the bore in order to form a base line from which to compare the view of the second test. Did that make sense? It's a lot faster to actually perform the test than it just took to type it. Really.
FWIW, the wood dowel should fit a little bit snug in the bolt bore so a not to give a false result. If you can find someone with a lathe, they can whip you out a plug with a perfectly centered hole in nothing flat. Use a 3/4 inch dowel to start.