Check for rub marks on the front of the recoil shoulder in the stock and the back of the recoil lug of the barreled action.

If there's movement causing rub marks, until you bed it you're just spitting into the wind testing loads.