Example usage for org.apache.lucene.analysis.core WhitespaceTokenizer WhitespaceTokenizer

List of usage examples for org.apache.lucene.analysis.core WhitespaceTokenizer WhitespaceTokenizer

Introduction

In this page you can find the example usage for org.apache.lucene.analysis.core WhitespaceTokenizer WhitespaceTokenizer.

Prototype

public WhitespaceTokenizer(AttributeFactory factory) 

Source Link

Document

Construct a new WhitespaceTokenizer using a given org.apache.lucene.util.AttributeFactory .

Usage

From source file:org.netomi.lucene.DMSoundexFilterTest.java

License:Apache License

static void assertAlgorithm(boolean inject, String input, String[] expected) throws Exception {
    Tokenizer tokenizer = new WhitespaceTokenizer(new StringReader(input));
    DMSoundexFilter filter = new DMSoundexFilter(tokenizer, inject);
    assertTokenStreamContents(filter, expected);
}