Example usage for org.apache.lucene.analysis.miscellaneous ASCIIFoldingFilter ASCIIFoldingFilter

Introduction

In this page you can find the example usage for org.apache.lucene.analysis.miscellaneous ASCIIFoldingFilter ASCIIFoldingFilter.

Prototype

public ASCIIFoldingFilter(TokenStream input, boolean preserveOriginal) 

Source Link

Document

Create a new ASCIIFoldingFilter .

Usage

From source file:org.codelibs.elasticsearch.index.analysis.FingerprintAnalyzer.java

License:Apache License

@Override
protected TokenStreamComponents createComponents(String s) {
    final Tokenizer tokenizer = new StandardTokenizer();
    TokenStream stream = tokenizer;/*from w w w .  jav a2  s .c o m*/
    stream = new LowerCaseFilter(stream);
    stream = new ASCIIFoldingFilter(stream, false);
    stream = new StopFilter(stream, stopWords);
    stream = new FingerprintFilter(stream, maxOutputSize, separator);
    return new TokenStreamComponents(tokenizer, stream);
}

---

From source file:org.elasticsearch.analysis.common.ASCIIFoldingTokenFilterFactory.java

License:Apache License

@Override
public TokenStream create(TokenStream tokenStream) {
    return new ASCIIFoldingFilter(tokenStream, preserveOriginal);
}

---

From source file:org.elasticsearch.analysis.common.ASCIIFoldingTokenFilterFactory.java

License:Apache License

@Override
public Object getMultiTermComponent() {
    if (preserveOriginal == false) {
        return this;
    } else {/*from   w  ww  .jav  a  2  s.  c o m*/
        // See https://issues.apache.org/jira/browse/LUCENE-7536 for the reasoning
        return new TokenFilterFactory() {
            @Override
            public String name() {
                return ASCIIFoldingTokenFilterFactory.this.name();
            }

            @Override
            public TokenStream create(TokenStream tokenStream) {
                return new ASCIIFoldingFilter(tokenStream, false);
            }
        };
    }
}

---