I’d worry more about movement than colors.
Exactly. But if you're worried about it go to wally world and get a roll of camo flat finished(Not Glossy) Tape and tape up all the stainless before hunting season. I wouldn't leave it on after that. I'd untape it after season and clean any tape glue off with some brake cleaner on a rag. I've done this and never had a problem. In fact, I've taped up blued guns. Just be sure you take the tape off after season.