I wouldn't think there would be enough difference between the 3 to worry about.
Personally I wish I had the 458, as I'd like to use same bullets and then get a silencer that I could tap onto a 45 acp upper, a 45 acp, a 4570 and the 458 as a multi use can.... built large enough to handle the largest....
The 50 is fine. Just not that versatile and I don't have a 500 S/W and don't have a desire to either, at least not at this point in life. Though their recoil probably isn't worse than 300s in my 329.... but I don't like bulky handguns, if bulk isn't an issue I"d take my Contenders instead...
Jeff