Thanissaro Bhikkhu mentions in a Dhamma talk a study that showed that plain-looking people are hardest to seduce, because they are skeptical that attempts to seduce them are genuine.

Add to this a lack of being able to read bodily signals and cues well, and you have a recipe for long-term solitude, wanted or not. This does nothing to diminish craving, of course. But on the positive side, you do get a lot more free time.