Starsky,
Your dilemma is a common one and can be easily solved....
You need to get one of them super duper UBER cool slings, they will act as a counter weight and with enough practice you could actually use it to carry your rifle after years of practice of course.
I myself have not mastered this skill to carry my rifle so I usually ask someone to carry my rifle on my hunts.