J.S.
I would be annoyed, too, but since he's leaving I don't think you should be too bothered by it. Hopefully, the replacement person will be a lot more reasonable and understand that people have lives outside of work.
I am currently a SAHM, but before kids I had a high stress, long hours job in a tech field. There were several people who had families and all of them would sometimes refuse to work a weekend, a night or attend an early morning meeting because of family priorities. I never heard our director complain. All of us just did our best to reschedule. I believe it's totally reasonable that you will call in rather than attend in person. Most of my former co-workers would not even have offered to do that, nor would they have been expected to.