We have chosen not to vaccinate our children. Our oldest reacted to her first shot (tetanus) with grand mal seizures, and that was it for us. Our children are very healthy and I would rather risk the rare chance of a disease than have any more severe vaccine reactions. I would certainly rather my children have chicken pox, which isn't that severe, than the vaccine. You have to do what you believe is best for your children. Listen to your inner voice. At the very least, I would wait until children are two years old to begin any vaccination, and then I would give them one at a time.
As for your pediatrician, I am not surprised by his reaction. There are a lot of doctors out there who choose to punish their patients this way. Be glad you found out now because you can certainly find another doctor, maybe one that is closer to where you live, too. (Personally, we have never had a pediatrician, but rather a family practice doctor who can provide care for all of us.) I support you in your decision to wait. Do more research, and know that there are many parents out there who are doing the same thing.