Example usage for org.apache.lucene.analysis TokenStream subclass-usage

List of usage examples for org.apache.lucene.analysis TokenStream subclass-usage

Introduction

In this page you can find the example usage for org.apache.lucene.analysis TokenStream subclass-usage.

Usage

From source file org.watermint.sourcecolon.org.opensolaris.opengrok.analysis.List2TokenStream.java

public final class List2TokenStream extends TokenStream {

    private Iterator<String> it;
    private String[] subTokens;
    private int si;
    private final CharTermAttribute termAtt = addAttribute(CharTermAttribute.class);

From source file uib.retrieval.analyze.GraphTokenizer2.java

/**
 *
 * @author Olav
 */
public class GraphTokenizer2 extends TokenStream {

From source file uib.scratch.CustomTokenizer.java

/**
 *
 * @author Olav
 */
public class CustomTokenizer extends TokenStream {

From source file uk.co.flax.luwak.analysis.TermsEnumTokenStream.java

/**
 * A TokenStream created from a {@link org.apache.lucene.index.TermsEnum}
 */
public class TermsEnumTokenStream extends TokenStream {

    private final BytesRefIterator termsEnum;