Java org.apache.lucene.analysis.standard StandardTokenizer fields, constructors, methods, implement or subclass

Example usage for Java org.apache.lucene.analysis.standard StandardTokenizer fields, constructors, methods, implement or subclass

Introduction

In this page you can find the methods, fields and constructors for org.apache.lucene.analysis.standard StandardTokenizer.

The text is from its open source code.

int	ALPHANUM Alpha/numeric token type
String[]	TOKEN_TYPES String token types that correspond to token type int constants

	StandardTokenizer() Creates a new instance of the org.apache.lucene.analysis.standard.StandardTokenizer .
	StandardTokenizer(AttributeFactory factory) Creates a new StandardTokenizer with a given org.apache.lucene.util.AttributeFactory

void	close()
void	end()
boolean	incrementToken()
void	reset()
void	setMaxTokenLength(int length) Set the max allowed token length.
void	setReader(Reader input) Expert: Set a new reader on the Tokenizer.