I have used silk, wool, cotton, and more than one kind of synthetic.

If I am moving about silk is fine and so is lightweight synthetic. If I am sitting in a tree stand then heavy synthetics or merino wool works better for me.