Example usage for edu.stanford.nlp.process DocumentPreprocessor setEscaper

List of usage examples for edu.stanford.nlp.process DocumentPreprocessor setEscaper

  1. HOME
  2. Java
  3. edu.stanford.nlp
  4. edu.stanford.nlp.process.*
  5. DocumentPreprocessor
  6. setEscaper

Introduction

In this page you can find the example usage for edu.stanford.nlp.process DocumentPreprocessor setEscaper.

Prototype

public void setEscaper(Function<List<HasWord>, List<HasWord>> e)

Source Link

Document

Set an escaper.

Usage

From source file:edu.nyu.nyuvis.cfutils.nlp.processors.TwitterProcessor.java

@Override
public List<Sentence> tokenize(Document doc) {
    DocumentPreprocessor tokenizer = new DocumentPreprocessor(new StringReader(doc.text()));
    tokenizer.setEscaper(null);
    return CoreNLP.convert(tokenizer);
}