We generally do what you do - we don't really have dessert, but you eat until you're full. If you get hungry later, we can reheat something or have a healthy snack. But sometimes, like last night on the way home from our daughter's tumbling class, she asked for ice cream. We don't have that all the time, and she had just done 45 minutes of tumbling. No I don't want to reward with food, but we did stop by for a small ice cream cup from Dairy Queen; and she and I sat in the car having our ice cream and enjoying each other's company.
I feel you're treading thin ice because, while it may not be heart healthy for hubby to have swiss rolls, right now he has a high metabolism, and he's thin. If you ask him to not have dessert until your child goes to bed, then (possibly to her) it's like he's sneaking food, and is that really the behavior you want modeled for your daughter? Plus, he is a grown man - you're not his mom, you're his partner. There is a difference. (Not trying to be harsh, but just saying he could be taking it that way depending on your approach. Maybe if you talked about it outside of range of your daughter's hearing then you could come to an understanding about the situation.)
Dessert's don't have to be high calorie, high fat, all-time-awful stuff. What about strawberries and blueberries over angel food cake or shortcake? What about grapes and walnuts? What about sorbet?
Just like you can have breakfast for dinner, you can have "other healthier things" for dessert than typical dessert fare.
Just a few thoughts for what it's worth, and good luck!