Of those you have, the 30-06 is only giving up 50 fps at the muzzle but with a 180 vs 165. At 300 yards, it will carry more velocity (2116 vs 2082 fps) and energy than the 165. Drops are virtually identical at ~ 8.8" at 300 yards (200 yd zero). That's from plugging your numbers and specific bullets into RCBS.load's external ballistic calculator.

Attached Images
Theecks 30-06 Load.jpg (63.72 KB, 611 downloads)