Example usage for org.apache.hadoop.io.compress GzipCodec subclass-usage

List of usage examples for org.apache.hadoop.io.compress GzipCodec subclass-usage

Introduction

In this page you can find the example usage for org.apache.hadoop.io.compress GzipCodec subclass-usage.

Usage

From source file com.hadoop.intellipaat.SplittableGzipCodec.java

/**
 * For each "split" the gzipped input file is read from the beginning of the
 * file till the point where the split starts, thus reading, decompressing and
 * discarding (wasting!) everything that is before the start of the split.<br>
 * <br>
 * <b>FACT: Files compressed with the Gzip codec are <i>NOT SPLITTABLE</i>.

From source file io.gzinga.hadoop.SplittableGZipCodec.java

public class SplittableGZipCodec extends GzipCodec implements SplittableCompressionCodec {

    private static int buf_length = 32 * 1024;

    private long getHeader(SeekableGZipDataInputStream in, long loc) throws IOException {
        long position = loc;

From source file nl.basjes.hadoop.io.compress.SplittableGzipCodec.java

/**
 * For each "split" the gzipped input file is read from the beginning of the
 * file till the point where the split starts, thus reading, decompressing and
 * discarding (wasting!) everything that is before the start of the split.<br>
 * <br>
 * <b>FACT: Files compressed with the Gzip codec are <i>NOT SPLITTABLE</i>.