.22lr + .223 + .30/06 + 12ga = all the calibers someone needs to cover everything in America.
Other combos will do it, but not any better.
You can even toss the .223 out if you aren't a high volume target/tactical/p-dog hunter and just do everything from woodchucks to moose with the .30/06.
When I was a kid almost everyone I knew that hunted to feed their family only had 3 guns. A loaded 12 Guage that stayed behind the bedroom door when it wasn't being used. A 22 rifle and a "deer rifle". 90% of the time the that deer rifle would be either a 30/30, 243 or 30/06. I agree, with modern times a 223 needs to be in that mix.
