Can you get genital herpes without sexual contact?

I found out, after I shared a drink with him, that my friend's roommate has genital herpes. He had the HSV-2 virus, not the HSV-1 virus, that causes cold sores. The person with the herpes and I did not have any sexual contact whatsoever. We didn't kiss or hold hands, or touch each other at all, really. The only thing is I asked if I could have a sip of his drink. Is it possible for me to get his genital herpes from sharing a drink with him, or would I have had to have sexual contact with him? My friend said she shares drinks and food and stuff with him all the time, and has been for months, and she's never had a problem or gotten herpes from him. Am I at risk, or am I just over worrying?