I'd look at the 6MM stuff. Sure is fun picking off those "barkers" out there at 600+ meters.
While I've used an AR-15 type platform extensively, my favorite for putting the smack down on dogs is the 6mm Remington. I run 85 grain Sierra hollow point game kings at 3430 from a custom Tikka.