Your 06' with a 200 grain partition will kill anything in North America, right away if you hit what you are aiming at.
So, going down-in-size to a .223 might be a fun thing to do. It would give you a great long range varmint gun, and it's cheap to shoot/reload/shoot-again.
Just an idea...