Joel,
Mule Deer's load's are typically known for working in many cases. Not 100% of the time.
IMO, experience and from reading, at this point of finding the load for you '06 would not be by adjusting OAL; yet. Adjusting OAL and testing various primers are more....."fine" tuning. Trying different powder charges or different powders all together would be considered "major" tuning. Also, trying different bullets would be considered "major" tuning.
With that said, if you are set on using the 180 PT and Hunter, which are fine components, yes, adjusting OAL about 40 thou would be in order. You're at 2.735" now. Load up little 5-shot snacks of (assuming your 2.735" is on or near the lands) shorter OAL cartridges; 2.695", 2.655", 2.615". See which shoot best and then, if you want, fine tune ever more by working within the .04" range in smaller increments. Say, .01" increments. Once completed, try different primers. I didn't see velocities nor see one in the photo, thus I have to assume you're not using a chronograph. Not needed but always nice to have when looking for loads that vary little from shot to shot. Having shot to shot similarities in velocity helps keep your vertical impacts closer at longer distances. And seeings you have a CDS elev turret (14 minutes of adjustment) on that nice Leupold and your load, running around 2750 fps will take you out to well past 600 yds.
Did your 'smith tune the trigger pull nice and light? Helps with fine accuracy!
Some of my best loads come from using the Lee CND. Some come from using Redding Type-S Bushing die; the full length version for hunting and/or tactical rifles.
Hope this helps.
By the way, NICE looking rifle.
What are the components?
Alan