It’s possible that your “horrible ex” liked you when you were heavy because he thought heavy girls were easy to push around because they tend to have self-esteem issues. I’m heavy myself and I am leery of guys who are attracted to me because I don’t know if they have ulterior motivations.