The problem for blacks was never the "white man's math". It was always the "white man's IQ", and the "white man's social norms" and the "white man's value system" and the "white man's laws", and the "white man's Enlightenment understanding of individual liberty and responsibility".
