My family has no record of owning any.

Most of the time when asked of Americans this question means did they own any during the period where slaves from sub-Sahara Africa were imported here. But the fact is that if your people are from anywhere other than a small handful of remote islands, someone somewhere back owned a slave. Mostly from conquest rather than buying them at the dock, but they owned another person regardless.