The first time we stayed in the same hotel he had stayed with OW, I sat in the bathroom and cried....eventually I came out and we went to dinner and talked.
As time went on and we returned to those places it became easier. We created our own routines, our own memories.....we had massages, breakfast in bed, we brought wine back to the room along with some munchies and had afternoon sex.......and eventually those places have become 'our places'. I used Wite-Out and OW is gone from those places now.
Life is too short to let some random hole deny us what can be sweet moments in our lives. You are not too sensitive...you've been hurt...but you will reclaim these moments...they belong to you.
Take good care of yourself and let your H know you need extra special love and attention this trip.....he needs to step up and make this a special time, for both of you.