Some well known ultralight backpackers still prefer fleece for consistently damp and wet conditions. Apparently even the synthetic puffies aren't very comfortable or warm when they are wet.

"Fleece clothing is often poo-poo�d because �puffy� clothing (insulated with goose down or synthetic fill) is much warmer for the weight. But in prolonged wet environments, I will inevitably get wet. And a wet puffy is cold and uncomfortable, regardless of the insulation type. The warmth of fleece is less effected: it retains less moisture and its loft is less effected. I longed for a fleece mid-layer to sandwich between my active layer and rain shell during the Alaska-Yukon Expedition, during which numerous storms overwhelmed my rain gear."


http://andrewskurka.com/2012/stupid-light-not-always-right-or-better/