I was married at the age of 18 to a brilliant musician. My marriage was troubled from the start, as I was unable to deal with my husband's need for order and perfection, his paranoia, his tourette syndrome (I didn't know there was a name for it back then), his checking everything, his put-downs, emotional detachment, etc. I knew from the beginning of our marriage that there was something not right about him.
We had two children. My daughter was like every other kid, but my son was different from the start. However, he was so much like his father in nearly every way. He learned to play guitar, self-taught at a very early age and went on to be a jazz musician. He was difficult as a child, often in trouble at school.
I too, spent 12 years extremely lonely and feeling unloved. At the age of 30, I had an EA. This man was someone that my empty soul felt could communicate with and who told me all the things I wished my H could have said to me.
We ended up divorcing. My son grew up to be brilliant like his father in so many ways, but so difficult, so verbally abusive, obsessive compulsive, etc. He had been misdiagnosed by professionals most of his life, until recently, at my insistence, he finally saw an autism specialist and was diagnosed with Autism Spectrum Disorder with Savant features. He is not Aspergers, and she explained that his autism is not on the "mild side", that he has too many autistic characteristics. My son has a college degree from a tech college, graduated with highest honors and has a good-paying job and performs and records musically. But his life is a disaster, and has made so many poor choices. He has very poor social skills. He can't maintain a relationship, like his father... needy, latches onto a woman, controlling and verbally and emotionally abusive and unavailable.
My XH was extremely phobic of mental health professionals and refused to get any help his entire life, but I have no doubt in my mind that he was autistic also. He passed away last year. He convinced himself that no diagnosis meant there was "nothing wrong."
I relate so well to your loneliness and desperation being married to a person on the autism spectrum. I had limited boundaries and coping skills, and I suffered from lack of self-esteem. I blamed my XH for years for the way he treated me until I learned of the autism and now I understand. It was the way his brain was wired.
I know an awesome woman who recently married a very cool guy with Aspergers. They are an older couple, so she comes equipped with a lot of resources and maturity to deal with and understand her H and his quirkiness. When she feels like hitting him with her frying pan, she comes to me and we have a girl talk.
She said to me once, "I sometimes just can't figure him out!!" ... and I told her, "Nobody can. Just love him. You can do that!"