Doesn't have to be that way. The rifle has to be a comfortable to hold when in a relaxed state. One of the most important things when shooting offhand (deliberately) is the positioning of the feet and hence the torso.
If your feet were perpendicular to the target your torso would have to twist to the left. When a shot is let off your muscles relax and the shot will wander to the right and usually high as well.
Position your feet, close your eyes, relax, then open them looking through the scope. You'll find you'll we way off windage wise. Adjust your feet accordingly.
Use a sling as well. Hasty does just fine and 10x better than nothing.
