In my experience, the faster powders (Bullseye, Tite group, etc.) have a more abrupt and snappy recoil, even though the charge weights are smaller.
You may want to try a bit slower powder, and stay with the starting loads, which are generally lower with lead bullets.