If I were only to have one centerfire rifle it would get 10 times more use on varmints than deer. Deer and black bear is all the big game we have here and I don't have any reservations about shooting/killing either one with a good bullet from a .223. I'm not ever going to be rich enough to trot all over the country hunting big game so that would do me fine.
