I've read your other threads and your husband is not a safe partner. I think he's just going to continue to manipulate you for as long as you continue to let him.
I’m at fault for his affair because he didn’t feel I appreciated him, that’s basically what he thinks.
Nuh-uh. No. Nope. Things like this are why I say he's not a safe partner. He's at fault for the affair. Did you put a gun to his head and tell him he has no other choice but to sleep with a co worker? You need to stop worrying about his feelings and start focusing on you and your kids. Speaking of which...
he regrets having so many kids
Seriously? It sounds to me like he wants to blame everyone but himself for his problems (or what he perceives as problems. Your kids are not a "problem.").
ETA: I stopped typing because I'm on the verge of using a 2×4, but I also understand the pain and frustration you're feeling right now, so I'll not do that. That said, you need to stop enabling his behavior. What he did was unforgivable, and he went above and beyond to include so many aggravating factors.
It frustrates me to read the things he's said and done to you. That frustration is because I care. I care about you and what he's put you through. I think you need to pull a hard 180 and file for divorce.
[This message edited by Pogre at 11:44 AM, Thursday, January 22nd]