I am in the same situation and I am feeling really stressed today. I feel your pain!
I would take it to your attorney and put occupancy of the apartment as part of the negotiations.
It sounds as if it is convenient for him so why would he incur the cost of getting a place of his own.
Our divorce will be finalized in about six weeks so at least the end is in sight.
My WH treats it like a hotel. I am trying to detach and do the minimum but it is hard with children around. I can hardly snatch food out if his hands. I am just trying to grin and bear it. The weekdays are OK, it is the weekends that are miserable.