R.C.
It's a hard position to be in and you need to work on your self worth, self esteem, and self Confidence. Maybe you will need to go to a professional therapist to help you with this. So think about that and know the investment in yourself will be well worth it.
Right now he is with you and he's got some issues and feelings to deal with and decisions to make and might turn to you to talk things over to best figure out how best to handle things and you will need to be strong and patient with him. But remember the decisions has to be his to make. What you need to do is set limits ....put a silent time limit on him for making those decisions and stick to that limit.
If this process is going to be to hard for you, then you have your own decisions to make. Personally I would part ways for a while now giving him the space he needs to work out his issues, problems and come up with decisions.
Right now you don't know if the mother of his children will take him back or not but if he wants to go in that direction or is thinking of going in that direction, LET HIM GO and get on with your life without him. Don't see him or take him back unless he comes back a fee man knowing he wants to be with you and only with you and willing to father his children without being with the childrens Mom.
Hanging on to a man who is confused and doesn't know what he wants will put you through hell and chances are, it will destroy the relationship you have with him along with the wonderful memories you have of this relationship.