I would definitely bring either 2 strollers or a double stroller. I don't care how much your 3 year old likes to walk, NYC is a different animal. The streets are crowded and walking out into traffic is very hazzardous.
What kind of apartment does your friend have? Most NYC apts are very small. Where will the kids be sleeping? You'll definitley need a Pack and Play for the baby, or something similar.
The Circle Line is lots of fun and your 3 YO will like being on a boat. Also do the 911 memorial and then go to Chinatown for lunch or dinner. There will be lots to look at for your little one. Also, you can eat on Mullbury St. if you want to experience Little Italy. Or just get dessert - yum.
Take a walk over the Brooklyn Bridge and have pizza in Brooklyn. Cab or Subway it back. If you've bnever been on a NYC Subway, you must go for a ride.
Take a day to catch a show (perhaps if your friend is super cool she will watch the kids while you are enjoying an adult Broadway show with your hubby). Go to Top of the Rock or Empire State Building. Try the Museum of Natural History, too.
There is so much to do that you will have to narrow it down. Plan ahead if you want any tickets. I think it's better to spend a little more rather than wait on a two hour line for cheaper tickets.
And May is beautiful in NYC - definitley go to Central Park and go to the Zoo. Or, go to the Bronz Zoo - it's awesome. And just a subway or bus ride away. Go to a Mets game (cheaper and easier to get tix than the Yankees).
And by all means, get a hot dog (dirty water dog) and pretzel from a street vendor. Delish! Street food (aka Street Meat) is all the rage now (6th in the 50s) don't be afraid to try it.
Have fun - there is so much to see. And buy a Time Out NY when you get in.
Haha - I agree about the bathrooms!! All hotels have great bathrooms - but I heard that Starbucks is closing bathrooms to the public.