Example usage for Java org.apache.lucene.analysis.standard ClassicTokenizer fields, constructors, methods, implement or subclass
The text is from its open source code.
ClassicTokenizer(AttributeFactory factory) Creates a new ClassicTokenizer with a given org.apache.lucene.util.AttributeFactory | |
ClassicTokenizer() Creates a new instance of the ClassicTokenizer . |
void | setMaxTokenLength(int length) Set the max allowed token length. |