Example usage for org.apache.lucene.analysis.shingle ShingleFilter setMaxShingleSize

Introduction

In this page you can find the example usage for org.apache.lucene.analysis.shingle ShingleFilter setMaxShingleSize.

Prototype

public void setMaxShingleSize(int maxShingleSize) 

Source Link

Document

Set the max shingle size (default: 2)

Usage

From source file:com.ibm.watson.developer_cloud.professor_languo.pipeline.primary_search.NgramAnalyzer.java

License:Open Source License

@Override
protected TokenStreamComponents createComponents(String fieldName) {
    Tokenizer tokenizer = new StandardTokenizer();
    ShingleFilter sf = new ShingleFilter(
            new StopFilter(new LowerCaseFilter(new StandardFilter(tokenizer)), STOP_WORDS_SET));
    sf.setMaxShingleSize(gap);
    // sf.setFillerToken("");
    // sf.setOutputUnigrams(false);
    return new TokenStreamComponents(tokenizer, sf);
}

---