They're caused by friction - your arms moving back and forth over the fabric, for example, causes the surface fibres to tangle together into little balls. You can get rough, stone-like things from dry cleaners, as well as electric clothes shavers. A cheap razor is good for getting rid of them too.