You're not cleaning it right. After you think you're done run a quart of boiling water thru it. After it dries, plug the bbl, fill the barrel with Kroil, dump it out. store it muzzle down on an old rag. It will never rust again.
If that was the case then my CVA would be rusty as well.