Example usage for Java org.apache.lucene.analysis.icu.segmentation ICUTokenizer fields, constructors, methods, implement or subclass
The text is from its open source code.
ICUTokenizer(ICUTokenizerConfig config) Construct a new ICUTokenizer that breaks text into words from the given Reader, using a tailored BreakIterator configuration. | |
ICUTokenizer() Construct a new ICUTokenizer that breaks text into words from the given Reader. |
void | setReader(Reader input) Expert: Set a new reader on the Tokenizer. |