> The tokens would appear in error-handling rules, which are not shown
> in the grammar. It depends too much on the way you write your program
> how you handle the skipping of incorrect rules, and trying to include
> it into the grammar would obscure the grammar too much..
[I quoted this part at random just to indicate a reply]
Thank you for helping clarify everything regarding the tokenization,
sorry for my confusion, I'm just not used to doing tokenization
independent of the grammar itself.
One other question:
UNICODE-RANGE, unicode, escape, and others all use a different number
of hex digits, {1,4}, {1,8}, {1,6}. Why is this? Why do we need
more than 4?
__ __ __ __ __ __ __ __ __ __ __ __ __ __ __ __ __
Mortar: Advanced Web Development <http://mortar.bigpic.com/>
Neil St.Laurent <mailto:stlaurent@bigpic.com>
Big Picture Multimedia +1.403.265.8018