That 56.5gn load with H4350 is quite mild. I would work up further. Most rifles will take several more grains.
That charge will only be generating around 2600fps, maybe a little more which is under the 2800-2850fps potential for a 180gn bullet in the .30/06.
^^^^^^ This
I've had numerous 30-06 rifles shoot Partitions very well. I'd load 3 ea of 57, 58, 59 grains of H 4350 under a 180 Part, seated 0.010-0.020 off L&G. I'd bet a nickel one of them will turn in MOA - if your rifle is bedded properly. I'd also consider Re 17 under the 180. My current 06 shoots a smidge better with Re 17 than H 4350 with the 180.
. My 22" howa runs 2650 fps with 56.5 and 2700fps with 57gr. 
