M.P.
It does take forever to get out of the house in the winter but I wouldn't stop stollering at all. I have bundle me's for the stroller and a weather cover. Until it's under 20 degrees and if you dress them properly and make sure ears and hands are covered, they will be fine outside. I put baby legs on my kids in the winter and always an extra layer than I wear and I've never had a problem. You could also wear one baby and alternate. That keeps them and you really warm. I put my son in my Ergo on my chest or back and he stays really toasty.
have fun this winter.