I've done that many times and in colder temperatures. First of all, I see nothing wrong with your ideas, but I would suggest either a Silk weight or a Light Weight Capliene base layer not wool. Wool stays wet and dries out much slower than Capliene. That's what will chill you when you stop to glass for a while. The combination works very well because it breathes well and passes moisture. E
