Example usage for org.apache.lucene.analysis.core LetterTokenizer LetterTokenizer

Introduction

In this page you can find the example usage for org.apache.lucene.analysis.core LetterTokenizer LetterTokenizer.

Prototype

public LetterTokenizer(AttributeFactory factory, int maxTokenLen) 

Source Link

Document

Construct a new LetterTokenizer using a given org.apache.lucene.util.AttributeFactory .

Usage

From source file:ci6226.NumberAnalyzer.java

@Override
protected NumberAnalyzer.TokenStreamComponents createComponents(String arg0, Reader reader) {
    TokenStream source = new LetterTokenizer(Version.LUCENE_47, reader);

    return new Analyzer.TokenStreamComponents((Tokenizer) source, source);
}

---

From source file:com.mathworks.xzheng.analysis.codec.MetaphoneReplacementAnalyzer.java

License:Apache License

@Override
protected TokenStreamComponents createComponents(String fieldName, Reader reader) {
    Tokenizer source = new LetterTokenizer(Version.LUCENE_46, reader);

    TokenStream tokenStream = new MetaphoneReplacementFilter(new LetterTokenizer(Version.LUCENE_46, reader));
    return new TokenStreamComponents(source, tokenStream);
}

---

From source file:org.elasticsearch.index.analysis.LetterTokenizerFactory.java

License:Apache License

@Override
public Tokenizer create(Reader reader) {
    return new LetterTokenizer(version, reader);
}

---