Wow, your husband is very cruel. I have a surprise for him though, you are absolutely NOT stuck with him. You have the power to call it quits any time you damn well please.
I'm sorry your WH isn't/wasn't remorseful and immediately willing to rebuild your marriage. My WH was involved with someone much younger as well- an additional kick in the self esteem teeth.
I don't know much about recovery from infidelity as I'm pretty new myself, but I do know that your WS doesn't deserve you and the gift of reconciliation that you offered him.