Most folks around here would just shrug and walk away without a second thought. It's the kooks you've gotta appease.
A Surefire Mini is only 5.5" long and part of that covers your muzzle brake, so it only adds a few inches to the overall length. And if you run a long rail, it's doubtful anyone but a gun nut would notice it (even if they heard you shoot it).