It’s quite high risk in that I’ve had rifles that had interchangeable loads or same POI for different bullets but they never reliably stayed that way. Taking the barrelled action out the stock and putting it back changed it or they just diverged for no discernible reason. I now much prefer adjusting the scope
As I hinted at earlier, unless you use temperature-resistant powder the POI of a certain load may very well change at different temps.
Might also add that I have several rifles that will consistently shoot all the bullet weights I might use in them close enough to the same POI at 100 yards that I can switch loads without any problem--and have for years, even when taking the barreled action out of the stock, which I do frequently when I fly somewhere to hunt, in order to use a take-down case.
These rifles include all of my varmint rifles from .17 Hornet up to a heavy-barreled .243, regardless of bedding. Others are my New Ultra Light Arms .30-06 (full-bedded forend, which shoots 150-200 grain loads to the same POI; my custom FN Mauser .338 Winchester Magnum (free-floated barrel) with bullets from 200-250 grainsl; my 9.3x62 CZ 550 (full-bedded barrel) with loads from 250-300 grains; and my .375 H&H Mark X Mauser (free-floated barrel) with 260-300 grain bullets. When I get to where I'm hunting, I put the rifle together again and take a test-shot. Sometimes it lands maybe 1-1/2 inches away from where it was zeroed back home, but a second shot always lands in the right place. All of these rifles are epoxy-bedded, but only one is pillar-bedded--with only one pillar. NULAs only have one pillar, as I recall for the rear action screw, because the bedding for the front of the action is solid epoxy.
However, I used to travel a lot with a custom 7x57 bolt rifle, and because I like to field-test different bullets I tried to get it to shoot various weights to the same place. No go--but it would shoot any bullet from 156-162 grains to the same 100-yard POI, so I used those. On one cull safari in Africa I tested 4 different bullets, the 156 Norma Oryx, 160 Barnes TSX, 160 North Fork and 160 Sierra GameKing on a bunch of animals without readjusting the scope.