A brake can affect scopes on lighter rifles, for the same reason a springer air rifle is much harder on scopes than the mild recoil would suggest: The brake can result in the rifle starting backward, then suddenly stopping, or even going forward a little as the powder gas goes through the brake. In other words, different vibrations than many scopes are designed to resist.
This effect has been noted by more than one gunsmith who makes really light hunting rifles.
