I noticed this with a wheel bearing, once installed correctly there was no play in the wheel. I would assume headsets would be the same. If it feels smooth and doesn't have play when installed I wouldn't worry about it.