Not an evergreen, but native, and produces piles of crabapples that feed all kinds of critters.
https://www.musserforests.com/prod.asp?p=SWCRThis place has a bunch of crabapple varieties. Ones with persistent fruit are probably what you want. Not sure which one I have, but it puts out big-time.
https://www.gardenia.net/guide/flowering-crabapple-with-persistent-fruit