TokenParser.parseToken(CharArrayBuffer buf,
ParserCursor cursor,
BitSet delimiters)
Extracts from the sequence of chars a token terminated with any of the given delimiters
discarding semantically insignificant whitespace characters.

TokenParser.parseValue(CharArrayBuffer buf,
ParserCursor cursor,
BitSet delimiters)
Extracts from the sequence of chars a value which can be enclosed in quote marks and
terminated with any of the given delimiters discarding semantically insignificant
whitespace characters.