Example usage for org.apache.lucene.analysis.standard UAX29URLEmailTokenizer TOKEN_TYPES

Introduction

In this page you can find the example usage for org.apache.lucene.analysis.standard UAX29URLEmailTokenizer TOKEN_TYPES.

Prototype

String[] TOKEN_TYPES

To view the source code for org.apache.lucene.analysis.standard UAX29URLEmailTokenizer TOKEN_TYPES.

Click Source Link

Document

String token types that correspond to token type int constants

Usage

From source file:indexer.TweetAnalyzer.java

@Override
protected boolean accept() throws IOException {
    return !(typeAttr.type() == UAX29URLEmailTokenizer.TOKEN_TYPES[UAX29URLEmailTokenizer.URL]);
}

---

From source file:webdocs.WebDocAnalyzer.java

@Override
protected boolean accept() throws IOException {
    boolean isURL = typeAttr.type() == UAX29URLEmailTokenizer.TOKEN_TYPES[UAX29URLEmailTokenizer.URL];
    return !isURL;
}

---