That would be an accurate assumption in a couple of cases! So to answer the OP's question, yes there are builders out there who can in fact, make a rifle that shoots sub moa with a variety of loads and will feed/function flawlessly. No return trips necessary, no third party work needed. Take it out of the box, load some ammo and go hunt something. Only hangup for many is the cost, it was never cheap and these days some of the prices border on astronomical. If one can afford them and desires what they turn out, he will be rewarded with a lifetime investment in 100% reliable performance and workmanship using quality materials that can be passed down to the next generation. As Allen Day believed, I'd rather have 2 or 3 of these type rifles than an entire closet full of anything else.
But, if one cannot afford or doesn't care to invest the funds necessary to own something like this, he can happily hunt the world with a number of factory produced rifles. I have several friends that do just that, but they are strictly hunters and to them it's simply a tool. Browning A bolts, Sako A7s, current versions of M70s and Weatherbys are their choices and admittedly they get the job done. None of them even reload, shoot nothing but factory ammo.