In above-freezing wet weather, a puffy against a waterproof shell of any sort will wet out on the outer surface from condensation, at least in my experience.
In wet weather, I wear a fleece over the puffy. The fleece layer against the waterproof layer keeps the puffy from wetting out. When the weather breaks and you get a chance to take off the shell, the fleece does what it does and dries quick.
The fleece might be sized such that the loft of the puffy is a bit compressed, but at above-freezing temps the compressed lofts hurts you way less than being wet.
None of this matters when it's dry and/or well below freezing.
