Many years ago my only centerfire rifle was a Remington 700 BDL sporter. I used it for both deer and woodchucks. Back in the early 1980s, there were no plastic point varmint bullets. I shot 87 grain Sierras and 90 grain Sierra HPBT bullets in that rifle with good results on varmints. I think I used between 52 and 54 grains of IMR 4831 for both bullets. Velocities ranged from 3,200 to 3,400 fps.
Given your powder choices, I would try IMR 4350 first, then H 4831SC. Varget would probably work, but I would use slower powders in the 25-06. Check the Hodgdon loading magazine for charge weight guidelines on these powders. You might also check a Nosler manual for the most accurate powder using Nosler 85 grain Ballistic Tips.
