I wear my S&W Mdl 29 .44 in a chest holster when I'm riding the wheeler in to where I'm hunting. If I'm cutting up a critter in the dark I'll strap it on as well. Otherwise it's just a sleeping companion any more. My .300 packs plenty of punch and is enough for me to carry around when I'm hunting. The longer I live here the more respect for brown fuzzies I have, but less fear and concern also. As far as which handcannon to carry, whichever one you shoot well and want to drag around. That .500 seems like it would be unpleasant. I'd rather carry extra water and/or my 22/45 lite to put some birds in the frying pan if the big game wasn't cooperating that day.
