Yes, good for you.
I did the same thing last summer. I figured that because he loved golf so much but had to give up his membership at his club, I would learn to golf so that we could have something that we could enjoy together.
I had only golfed a half dozen times before that, but I joined a fun, non-competitive ladies group and improved quite a bit. ( It's so much easier when you are not trying so hard)
Now we can golf together and it is great. I'm still not very good, but I can hold my own.
Don't give up. I'm lucky though that OW didn't do any sports at all that didn't require her to be on her knees.