Example usage for Java org.apache.lucene.analysis.ja JapaneseTokenizer fields, constructors, methods, implement or subclass
The text is from its open source code.
Mode | DEFAULT_MODE Default tokenization mode. |
JapaneseTokenizer(AttributeFactory factory, UserDictionary userDictionary, boolean discardPunctuation, Mode mode) Create a new JapaneseTokenizer using the system and unknown dictionaries shipped with Lucene. | |
JapaneseTokenizer(UserDictionary userDictionary, boolean discardPunctuation, Mode mode) Create a new JapaneseTokenizer. |
int | calcNBestCost(String examples) |
void | close() |
boolean | incrementToken() |
void | reset() |
void | setNBestCost(int value) |