Until you have a "healthy" BMI, body weight will be a factor. Usually a big one.

For a rifle, my preference is my Savage Lightweight hunter in .308 that comes in just at under 7 pounds with scope, sling, loaded.

Any lighter and my offhand wobble increases a lot.

YMMV.