Example usage for org.deeplearning4j.models.embeddings.loader WordVectorSerializer writeFullModel

Introduction

In this page you can find the example usage for org.deeplearning4j.models.embeddings.loader WordVectorSerializer writeFullModel.

Prototype

@Deprecated
public static void writeFullModel(@NonNull Word2Vec vec, @NonNull String path) 

Source Link

Document

Saves full Word2Vec model in the way, that allows model updates without being rebuilt from scratches

Deprecation note: Please, consider using writeWord2VecModel() method instead

Usage

From source file:uk.bl.wa.nlp.wordvec.WordvecProcessor.java

License:Open Source License

public static void main(String[] args) throws Exception {

    SentenceIterator iter = new StanfordSentenceIterator(new FileReader("src/test/resources/Mona_Lisa.txt"));

    // Use Stanford NLP sentence splitter:

    // Split on white spaces in the line to get words
    TokenizerFactory t = new DefaultTokenizerFactory();
    t.setTokenPreProcessor(new CommonPreprocessor());

    log.info("Building model....");
    Word2Vec vec = new Word2Vec.Builder().minWordFrequency(5).iterations(1).layerSize(100).seed(42)
            .windowSize(5).iterate(iter).tokenizerFactory(t).build();

    log.info("Fitting Word2Vec model....");
    vec.fit();/*  w  w  w .  j  ava  2s  . c om*/

    log.info("Writing word vectors to text file....");

    // Write word vectors
    WordVectorSerializer.writeWordVectors(vec, "pathToWriteto.txt");
    WordVectorSerializer.writeFullModel(vec, "pathToWriteto.model");

    log.info("Closest Words:");
    Collection<String> lst = vec.wordsNearest("french", 10);
    System.out.println(lst);
    // UiServer server = UiServer.getInstance();
    // System.out.println("Started on port " + server.getPort());

}

---