There has been a report of problems with xine and vmix on Linux (here), not sure if this is the same issue, since you have problems without vmix too. Another (possibly unrelated) thing I've noticed: If you Ctrl-C osstest while it's playing, it will stop only after a bit more is played. On Linux this is instantaneous.