I debated the same for my Kimber. Ultimately went with 358.
Biggest reason was bullet options. From the reading I did, it sounds like many 338 bullets are made for the mags. Even some not performing well at 338/06 speeds.
I also think the extra width of the 358 bullets is beneficial.
Will it kill a deer or bear any deader? Probably not. But, I like it!