Also, keep in mind that the vast majority of what’s left of the ancient world is worked stone. Imagine what they could do with wood, bone, textiles, and other materials that don’t last like stone.

And the idea of ancient humans being “cavemen” is ridiculous. Stuff just gets preserved in caves for tens of thousands of years. So what we have of people that far back is only what’s found in caves. I doubt people only lived in caves back then. In more recent times within the last 500 years people lived in caves but during periods of war or famine to protect themselves from marauders.