Mid-twenties dating a guy in his mid-30's?

This guy is very different from me. I'm conservative, haven't dated much at all. He's told me he use to party a lot but has settled down. He goes out drinking often, smokes and said he's experimented with a lot of drugs when he was younger. He seems like a nice guy, but hearing all this makes me question if I should even waste my time.

I really enjoyed hanging out with him. I felt really comfortable around him and he seemed very interested in me. I'm just kind of confused. I'm wondering why he would want to be with someone like me since I'm sort of the opposite of him. What do most guys want when they're in their mid-thirties? Could a relationship work when two people are so different?