I bought one of these slings last year and have used it religiously since. Grips my shoulder really well and doesn't slip, even over my backpack straps. It solved the exact issue the OP described and was a 15 dollar solution.
http://www.butlercreek.com/products/mountain_slings.html
