Twitter contacts

In the past few weeks, people I start following on Twitter won't show up in my People hub. I noticed that some people I'm Facebook friends with didn't have a linked Twitter account, of which I couldn't find by itself either.

I removed my Twitter account and re-added it, which seemed to fix it, but since then, people I follow will not show up in the hub, no matter how many times I refresh it or restart the phone.

Is anyone else experiencing this currently? I don't want to have to keep re-adding my Twitter account for every new batch of people I follow :p