He put his hand on a Bible and swore an oath to uphold the Constitution. If he now has a change of heart, like it appears, he should be removed from office via impeachment.