I'm a BW, and I said the same thing after I found out about the A.
My WH traveled a great deal, usually every other week for his career job, and he owned his own dojo where he taught two nights a week, plus there were competitions, special workouts, a couple of weekends away per year, all of that added to a great deal of resentment on my part. After the A, I looked back at his expense accounts and calendars, he was generally gone from home about 170 nights per year.
The job was one thing, those extra hours putting his time and energy into his love of the martial arts was always a thorn in my side. I understood he needed an activity he enjoyed away from the family, but he spent HOURS between the dojo, running that part-time business, setting up these special events, etc. and participating in them.
It made me realize how selfish he was. It was all about his happiness. Period. Then came the A, it was an extension of his selfish nature.
I did articulate how I felt several times, but it was always ignored, would blow over until the next time, lather, rinse, repeat.
The marriage and the family were #3 and #4 on his priority list.
I was a stay-at-home mom with a little part-time job, three children who were involved in sports, scouts, etc, one who was ADHD....family lived out-of-state, I needed WH to be there for me, but he was always there for everyone else.
After the A, he sold his dojo and quit martial arts. Thirty-seven years of his hard work down the drain because of his own selfishness and stupidity and inability to figure out a work/life balance.