The initial population reduction will make it doable. But you would want a very diverse source of calories. Any type of red meat would be a rare meal.

Indigenous people lived just fine in North America. Life expectancy won’t be the same but the human race will go on.