M.P.
Oh my! I suggest you put up with his not working, not because you love him, but because you don't love yourself enough.
You need to find a way to have a back bone, to put it crudely. IOne way out is to recognize it's your money! Sock it away and do not use it for day to day living. Do not enable him to not work.
I would take a long hard look at what I was getting out of this marriage. Sounds like you're willing to accept it the way it is is because it's better than your first marriage. I suggest you deserve better.
At the very least, I suggest that you and he need to get on the same page as far as finances go. Perhaps you don't argue about finances because you aren't willing to take a stand. A stand which would be very reasonable. A stand that requires that he contribute financially to this relationship in a consistent manner.
I would be up front with him and tell him that whatever money you get from your ex will be put away in a savings acct and will not be spent on day to day living. Then stick to it.
I also suggest that you use some of that money to get started in counseling so that you will find out that you are a good person who deserves better. I'm not saying you need to leave him. I'm saying you need to learn ways to stand up for yourself and get what you deserve.