I understand your feelings. For some time after DDay2 I went ballistic with sex, as I felt that he had to show me I was wanted, desirable, sexy, beautiful, etc. I needed that affirmation from him.
Except, he was much like your husband. And my self esteem got even worse.
So we discussed it, a lot. He DID desire me, see me as sexy, etc. but he was so ashamed of what he'd done that made it harder for him. Add in that he is a newly recovering sex addict and he was afraid of acting out with me, he went completely opposite and cautious. I was like, but you're SUPPOSED to have sex with me!!!!
Then I also realized I would question him about the affairs and such later at night in our bedroom (away from the kids, after the kids were in bed). Then *I* would want to reconnect through sex, but he was feeling very...beat up so to speak (not that I beat him up metaphorically) just...through the ringer after we'd spend an hour or more questioning. How was he supposed to feel sexy after I just railed him about sex with his APs???
I also found out that if I did initiate and he finally responded, then doubt would creep in, so then I'd say, are you doing this because you feel obligated? Please don't do this because you have to, etc. So then he'd quickly get out of the mood because I'd doubt his sincerity.
So I realized several things. *I* was being unhealthy by looking to him/sex for affirmation.
I sometimes sabatoged the mood by discussing the A's right before sex, or telling him "you don't have to be obligated" and doubting him.
Now, I keep any A talk completely separate, not at bedtime, not any time near sex time at all. Ever.
I never doubt him. If he didn't want me, he wouldn't have sex with me.
Sometimes, his shame is very palpable, and if it is, I need to realize, that's not sex time.
And I'm looking at the many other ways to get positive affirmation, not through sex.
Not sure if any of that relates to you in any way...but it worked for us.