E.T.
I have a bit of a people pleaser complex too and here's what has worked for me. First, before I hover over my husband, I ask myself if it's something I'd want him to be doing for me. For example, it makes me happy if he offers to make me lunch if I'm busy. But if I say no and he keeps offering things -- a cookie? water? help doing that project? is the house too warm? then it starts to annoy me. I try to stop myself from veering into that annoying territory.
Sometimes people become people pleasers because they don't feel worthy of their partners love. Like, you feel that you have to keep working hard or else he'll stop loving you. Or you've been conditioned to behave like this. Either way - a good therapist can really help you work through it. It doesn't mean you have a major issue, just something that a professional can help you work through.