Thats what we do now, attach, but there is the crack in the middle that can and will give a cold spot.. if i could find a backpacking size/weight, that would do away with that seem, and really wouldn't have to be super wide anyway, I'd buy it and see...
Even putting 2 seperate pads in a big sleeve can give you that cold crack issue...
Just thinking out loud here..