I've had this happen on a couple of bolt action rifles. The easy solution was to obtain rings that included windage adjustments in the rear ring, maybe they don't make 'em of a No. 1.
Phil