My dad was a one rifle, one load guy. Killed everything (deer, elk, moose) with his 06 and 165 grain Nosler Partitions, nothing else. I put way too much thought into it and have a reloading bench with all kinds of different calibers and bullet weights. But I like that, so...
Stick with what you know and have confidence in, 165 grain and your 300 Weatherby will do it all.