An honest 1.5" ain't great, but ain't awful either. I don't know where you are or where you hunt, but you could very well do every thing you need with that kind of accuracy.
Replacing the barrel would be very expensive, of course. Have you played with the bedding, with other loads, have you tried a break-in process? There's a lot you can do before dropping a bunch of money on another barrel and it's pretty early in the year so you have some time. Something like a bedding issue could result in you spending a bunch on a new barrel and ending up the same place you are now. You may have done all this, but you didn't say.
It's your gun and your money, of course so by all means do what makes you happy.
