I think this means that the two of you need to schedule some time to be with each other outside the hustle and bustle of life. The stress has him exhausted and you insecure. Take a evening to just be with each other to do something together as a couple.
I can understand that this might be hard right now especially if you are angry over missing the cruise (I would be). See what is possible for you to do.