List of usage examples for org.apache.lucene.analysis.miscellaneous FingerprintFilter FingerprintFilter
public FingerprintFilter(TokenStream input, int maxOutputTokenSize, char separator)
From source file:org.codelibs.elasticsearch.index.analysis.FingerprintAnalyzer.java
License:Apache License
@Override protected TokenStreamComponents createComponents(String s) { final Tokenizer tokenizer = new StandardTokenizer(); TokenStream stream = tokenizer;//from w w w . j a v a2s . c o m stream = new LowerCaseFilter(stream); stream = new ASCIIFoldingFilter(stream, false); stream = new StopFilter(stream, stopWords); stream = new FingerprintFilter(stream, maxOutputSize, separator); return new TokenStreamComponents(tokenizer, stream); }
From source file:org.elasticsearch.analysis.common.FingerprintTokenFilterFactory.java
License:Apache License
@Override public TokenStream create(TokenStream tokenStream) { TokenStream result = tokenStream;/*w ww . j a va2 s . c om*/ result = new FingerprintFilter(result, maxOutputSize, separator); return result; }