If you go back far enough there isn't anyone on this planet that doesn't have ancestors who owned slaves. Likewise there isn't anyone who doesn't have ancestors that were slaves. It's a statistical impossibility for it to be any other way.

How far back do we go before we're not on the hook for the sins of our fathers?