Example usage for org.apache.lucene.analysis.miscellaneous FingerprintFilter FingerprintFilter

List of usage examples for org.apache.lucene.analysis.miscellaneous FingerprintFilter FingerprintFilter

Introduction

In this page you can find the example usage for org.apache.lucene.analysis.miscellaneous FingerprintFilter FingerprintFilter.

Prototype

public FingerprintFilter(TokenStream input, int maxOutputTokenSize, char separator) 

Source Link

Document

Create a new FingerprintFilter with control over all settings

Usage

From source file:org.codelibs.elasticsearch.index.analysis.FingerprintAnalyzer.java

License:Apache License

@Override
protected TokenStreamComponents createComponents(String s) {
    final Tokenizer tokenizer = new StandardTokenizer();
    TokenStream stream = tokenizer;//from w w w .  j a  v  a2s  . c  o  m
    stream = new LowerCaseFilter(stream);
    stream = new ASCIIFoldingFilter(stream, false);
    stream = new StopFilter(stream, stopWords);
    stream = new FingerprintFilter(stream, maxOutputSize, separator);
    return new TokenStreamComponents(tokenizer, stream);
}

From source file:org.elasticsearch.analysis.common.FingerprintTokenFilterFactory.java

License:Apache License

@Override
public TokenStream create(TokenStream tokenStream) {
    TokenStream result = tokenStream;/*w ww  .  j a va2  s  .  c om*/
    result = new FingerprintFilter(result, maxOutputSize, separator);
    return result;
}