I like the VSSF well enough that I have bought 3 used ones over the years. I had the intentions to rebarrel them but 2 of them shot very well. I didn't even shoot the 3rd one before I rebarreled it. I paid $600 for each of them. Two of them have had the firing pins bushed and the third one with another Remington will be sent off soon. I used fluted Krieger barrels and they nearly look like factory rifles. They are chambered 22-250AI, 243 and 6.5-284. They all shoot between 1/4 and 1/2 inches consistently.
I never had a 204 but my Son has a 700, not a VSSF, in 204 that shoots great. If I was you I would take the check list that Grand posted and work through it. Good Luck
