This made me a little sad, because I had a wonderful grandfather, and my kids ...well, do not.
We are estranged from my father and from stbx's parents--for VERY good reasons.
Still, I can envision my kids, someday, wanting to see one grandparent or another; we went to see my "dying" father relatively recently at my son's request. (He wasn't dying--it was an elaborate way to get ego kibbles.)
The one thing I would tell you is that death--the process--is incredibly intimate, and it can be really confusing if your relationship is nebulous. And dying people are not always deathbed-reconciliation-ish. They can be cantankerous and obnoxious and as toxic as ever. I would be prepared for that.
I guess I would also try to figure out WHY I wanted to see him--and think about whether I was apt to be satisfied.
And then, if I still wanted to--I'd ask my mother. Is she emotionally safe enough to ask, Alyssa?