List of usage examples for org.apache.lucene.analysis.core WhitespaceTokenizer WhitespaceTokenizer
public WhitespaceTokenizer(AttributeFactory factory)
From source file:org.netomi.lucene.DMSoundexFilterTest.java
License:Apache License
static void assertAlgorithm(boolean inject, String input, String[] expected) throws Exception { Tokenizer tokenizer = new WhitespaceTokenizer(new StringReader(input)); DMSoundexFilter filter = new DMSoundexFilter(tokenizer, inject); assertTokenStreamContents(filter, expected); }