Example usage for org.apache.hadoop.mapreduce.lib.output FileOutputCommitter subclass-usage

Introduction

In this page you can find the example usage for org.apache.hadoop.mapreduce.lib.output FileOutputCommitter subclass-usage.

Usage

From source file org.apache.gobblin.compaction.mapreduce.CompactorOutputCommitter.java

/**
 * Class used with {@link MRCompactorAvroKeyDedupJobRunner} to rename files as they
 * are being committed. In addition to moving files from their working directory to
 * the commit output directory, the files are named to include a timestamp and a
 * count of how many records the file contains, in the format
 * {recordCount}.{timestamp}.<extensionName>(avro, orc, etc.).

From source file org.apache.parquet.hadoop.ParquetOutputCommitter.java

public class ParquetOutputCommitter extends FileOutputCommitter {
    private static final Log LOG = Log.getLog(ParquetOutputCommitter.class);

    private final Path outputPath;

    public ParquetOutputCommitter(Path outputPath, TaskAttemptContext context) throws IOException {

From source file org.schedoscope.export.ftp.outputformat.FtpUploadOutputCommitter.java

/**
 * A custom file output committer that transfers file to a (s)ftp
 * remote location.
 */
public class FtpUploadOutputCommitter extends FileOutputCommitter {

From source file parquet.hadoop.ParquetMultiOutputCommitter.java

/**
 * Commit job and write summary if is enabled
 *
 * @author Nguyen Duc Hoa
 */
public class ParquetMultiOutputCommitter extends FileOutputCommitter {

From source file parquet.hadoop.ParquetOutputCommitter.java

public class ParquetOutputCommitter extends FileOutputCommitter {
    private static final Log LOG = Log.getLog(ParquetOutputCommitter.class);

    private final Path outputPath;

    public ParquetOutputCommitter(Path outputPath, TaskAttemptContext context) throws IOException {

• «
• 1
• 2
• »