I've worked up many accurate loads with little concern about the seating depth for one reason or another and got great accuracy.
Other times it has made all the difference in the world. It certainly must be considered.