completely agree with fireproof. If you sense that you are falling too hard, too fast, protect yourself.
Set some ground rules....like,don't see him more than once a week, or find other social activities that don't involve this person. Occupy your need for happiness in other ways that are intrinsically good for you, no matter what happens with this person in the long term.
Big hug to you!