Having the scope touch probably means it is bearing against the barrel (pun not intended) this is put a lot of stress on your scope and won't do any good things for accuracy. May or may not cause problems with the rifle touching that close to the receiver,but certainly won't help any. I have set the barreled action in the Kurt vise and milled a little relief cut into the barrel with a 1" end mill. This allows me to mount the scope lower than switching rings when it is barely too low. If you take your time and make good cuts with a sharp mill, the finish will look fine- especially if it is stainless.
