FWIW, I don't own anything big big.
338-06 is go to moose round, have a couple bigger, but rarely think of them.
In your situation, bare bones minimum, shotgun for game. Something for defense. Large handgun. Small handgun. 22 rifle- 22 handgun might cancel the need for a 22 rifle, but my 10-22 with can serves a lot of purposes fairly quietly- but the can fits on the 22 pistol too..... 06 and then a 375 or 416 ish would suffice IMHO. Or again IMHO, you could sell the 06 and get a 338 win mag and let it do all the big game issues. My buddy ran one as a guide even on sheep stuff for so long I don't remember when he picked up a 416 ruger for bears finally... 338 stopped/helped stop a couple of big brown ones on the coast for clients as needed.
I have a light 284 if I ever get the chance to climb high for white things... I would not pack heavy for that...