Well, I'm back from the range. I've got good news and bad news.
Good news: It was the bullet. I shot 180 grain Hornady Interlock RN over H4895 and got no flyers. It was not a tight group, but it was a group. I shot 10 rounds and they all stayed inside a pie plate with room to spare.
Bad news: After all that trouble, all I have left is about a 4 MOA rifle with the current choice of bullet. I'm not done with it yet. However, that's where it stands.
Thanks all for you kind imput.