More lenses means less light transmission. Increased magnification and more compact design means more critical eye relief/eye box as well as more eclipsing at the extremes of the erector travel range, etc. Optical design certainly involves tradeoffs, but throwing money at the design can help mitigate some of the downsides inherent in the tradeoffs.
