Cleburne was born in Ireland. Served in the British Army as a private soldier. He later moved to Arkansas and made his home there.