Hang in there. My dday was three weeks after you so it's all still rather fresh for me, too.
But, agree with the others...he absolutely has to respect your wishes. Smartest thing I ever did was to make him move out and to keep contact with WH to an absolute bare minimum.
If that is what you need to keep you sane, then do it...no need to explain yourself to anyone, let alone the SOB.