Example usage for weka.core.stemmers SnowballStemmer SnowballStemmer

List of usage examples for weka.core.stemmers SnowballStemmer SnowballStemmer

Introduction

In this page you can find the example usage for weka.core.stemmers SnowballStemmer SnowballStemmer.

Prototype

public SnowballStemmer(String name) 

Source Link

Document

initializes the stemmer with the given stemmer.

Usage

From source file:europarl.Main.java

License:Open Source License

public static void main(String[] args) {

    //GLOBAL OPTIONS
    String target_word = new String("plane");
    for (String arg : args) {
        if (arg.startsWith("-")) {
        } else {/*from   w  ww. ja  v a 2 s. c  o  m*/
            target_word = arg;
        }
    }
    if (!Cfg.load_config("config/configuration.properties"))
        return;

    WordAlignment align = new WordAlignment();

    long startTime = System.currentTimeMillis();
    align.setStemmer(new SnowballStemmer("english"));
    align.getFromGz("data/it-en.A3.final.gz", target_word, -1);
    long endTime = System.currentTimeMillis();
    Main.log.info("Read in " + (endTime - startTime) / 1000.0 + " seconds");
    align.print();
    startTime = System.currentTimeMillis();
    endTime = System.currentTimeMillis();
    Main.log.info("Converted n " + (endTime - startTime) / 1000.0 + " seconds");

    align.saveToArff("./data/dataset_" + target_word + ".arff");
    return;
}