I should add, as noted I'd be more worried about headspace and I don't suggest swapping them as best bet, but with known builds that I have and using same components and headspace etc.... its never bothered me.
Now take a factory BCG lets just say DPMS, and swap it with a nice well built custom White Oak Precision, precision upper... nah, I'll pass on that.