Example usage for edu.stanford.nlp.international.spanish.process SpanishTokenizer coreLabelFactory

List of usage examples for edu.stanford.nlp.international.spanish.process SpanishTokenizer coreLabelFactory

  1. HOME
  2. Java
  3. edu.stanford.nlp
  4. edu.stanford.nlp.international.spanish.process.*
  5. SpanishTokenizer
  6. coreLabelFactory

Introduction

In this page you can find the example usage for edu.stanford.nlp.international.spanish.process SpanishTokenizer coreLabelFactory.

Prototype

public static TokenizerFactory<CoreLabel> coreLabelFactory()

Source Link

Document

a factory that vends CoreLabel tokens with default tokenization.

Usage

From source file:org.knime.ext.textprocessing.language.spanish.nodes.tokenization.tokenizer.word.StanfordNlpSpanishTokenizer.java

License:Open Source License

/** Static method to generate the TokenizerFactory with given options. */
private static final TokenizerFactory<CoreLabel> getTokenizerFactory() {
    final TokenizerFactory<CoreLabel> tokenizer = SpanishTokenizer.coreLabelFactory();
    tokenizer.setOptions(OPTIONS);//w ww. ja  v a2s  .  co  m
    return tokenizer;
}