If I ignore a person I am infatuated with would they hate me?

I met this man 7 months ago. I really like him but I kept my distance. I’m married.
Fast Forward to a few months later on, we would communicate a little bit more.
It seems I developed a connection with him. I think about him more often and wish to see him.
I finally stopped talking to him. I ignored him completely.
It hurts me when I see him. In the long run, I know this will all work out to benefit my marriage.
I want this man to hate me and despise me for making him feel invisible
What’s your take on it?.