For the use you mention, I lean toward .22 LR. A S&W M63 is a dandy carry gun, sights adjustable, easy to carry. Mine has S&W target stocks and suit perfectly, as the factory grips are just too small for average to large hands. The K22 is next up, to my way of thinking - M18 w/ 4" bbl; M17 w/ 6".

If personal protection is a player, I'd start w/ the 9mm and go up, preferably a caliber than begins in "4".