Class TokenStreamToAutomaton

Consumes a TokenStream and creates an Automaton
where the transition labels are UTF8 bytes (or Unicode
code points if unicodeArcs is true) from the TermToBytesRefAttribute. Between tokens we insert
POS_SEP and for holes we insert HOLE.

WARNING: This API is experimental and might change in incompatible ways in the next release.

Pulls the graph (including PositionLengthAttribute) from the provided TokenStream, and creates the corresponding
automaton where arcs are bytes (or Unicode code points
if unicodeArcs = true) from each term.

toAutomaton

Pulls the graph (including PositionLengthAttribute) from the provided TokenStream, and creates the corresponding
automaton where arcs are bytes (or Unicode code points
if unicodeArcs = true) from each term.