Oklahoma and Texas both are gonna be much lower tier teams than they are used to being once they’re in the SEC. I don’t think Riley was looking forward to competing with the likes of Georgia and Alabama, both on and off the field (recruiting). Head Coach at USC is a pretty coveted and high profile job. Competing in the PAC-12 against the likes of Oregon, both on and off the field likely suits him way better.
