Java org.apache.hadoop.mapred JobConf fields, constructors, methods, implement or subclass

Introduction

In this page you can find the methods, fields and constructors for org.apache.hadoop.mapred JobConf.

The text is from its open source code.

Subclass

org.apache.hadoop.mapred.JobConf has subclasses.
Click this link to see all its subclasses.

Field

String	MAPRED_TASK_JAVA_OPTS Configuration key to set the java command line options for the child map and reduce tasks.
String	DEFAULT_MAPRED_TASK_JAVA_OPTS
String	MAPRED_MAP_TASK_ENV Configuration key to set the environment of the child map tasks.
String	MAPRED_REDUCE_TASK_ENV Configuration key to set the environment of the child reduce tasks.
String	DEFAULT_LOG_LEVEL Default logging level for map/reduce tasks.

Constructor

	JobConf(Configuration conf, Class exampleClass) Construct a map/reduce job configuration.
	JobConf(Class exampleClass) Construct a map/reduce job configuration.
	JobConf(Configuration conf) Construct a map/reduce job configuration.
	JobConf(String config) Construct a map/reduce configuration.
	JobConf(Path config) Construct a map/reduce configuration.
	JobConf(boolean loadDefaults) A new map/reduce configuration where the behavior of reading from the default resources can be turned off.
	JobConf() Construct a map/reduce job configuration.

Method

void	addResource(String name) Add a configuration resource.
void	clear() Clears all keys from the configuration.
String	findContainingJar(Class my_class) Find a jar that contains a class of the same name, if any.
String	get(String name) Get the value of the `name` property, `null` if no such property exists.
String	get(String name, String defaultValue) Get the value of the `name`.
boolean	getBoolean(String name, boolean defaultValue) Get the value of the `name` property as a `boolean`.
Class	getClass(String name, Class defaultValue, Class xface) Get the value of the `name` property as a `Class` implementing the interface specified by `xface`.
Class	getClass(String name, Class defaultValue) Get the value of the `name` property as a `Class`.
Class	getClassByName(String name) Load a class by name.
ClassLoader	getClassLoader() Get the ClassLoader for this job.
Class	getCombinerClass() Get the user-defined combiner class used to combine map-outputs before being sent to the reducers.
boolean	getCompressMapOutput() Are the outputs of the maps be compressed?
Credentials	getCredentials() Get credentials for the job.
double	getDouble(String name, double defaultValue) Get the value of the `name` property as a `double`.
float	getFloat(String name, float defaultValue) Get the value of the `name` property as a `float`.
InputFormat	getInputFormat() Get the InputFormat implementation for the map-reduce job, defaults to TextInputFormat if not specified explicity.
int	getInt(String name, int defaultValue) Get the value of the `name` property as an `int`.
String	getJar() Get the user jar for the map-reduce job.
String	getJobLocalDir() Get job-specific shared directory for use as scratch space When a job starts, a shared directory is created at location `${mapreduce.cluster.local.dir}/taskTracker/$user/jobcache/$jobid/work/` .
String	getJobName() Get the user-specified job name.
String[]	getLocalDirs()
Path	getLocalPath(String pathString) Constructs a local file name.
long	getLong(String name, long defaultValue) Get the value of the `name` property as a `long`.
Class	getMapOutputKeyClass() Get the key class for the map output data.
Class	getMapOutputValueClass() Get the value class for the map output data.
Class	getMapperClass() Get the Mapper class for the job.
Class	getMapRunnerClass() Get the MapRunnable class for the job.
int	getMaxMapAttempts() Get the configured number of maximum attempts that will be made to run a map task, as specified by the `mapreduce.map.maxattempts` property.
long	getMemoryForMapTask() Get memory required to run a map task of the job, in MB.
long	getMemoryForReduceTask() Get memory required to run a reduce task of the job, in MB.
int	getNumMapTasks() Get the configured number of map tasks for this job.
int	getNumReduceTasks() Get the configured number of reduce tasks for this job.
OutputCommitter	getOutputCommitter() Get the OutputCommitter implementation for the map-reduce job, defaults to FileOutputCommitter if not specified explicitly.
OutputFormat	getOutputFormat() Get the OutputFormat implementation for the map-reduce job, defaults to TextOutputFormat if not specified explicity.
Class	getOutputKeyClass() Get the key class for the job output data.
RawComparator	getOutputKeyComparator() Get the RawComparator comparator used to compare keys.
Class	getOutputValueClass() Get the value class for job outputs.
Class	getPartitionerClass() Get the Partitioner used to partition Mapper -outputs to be sent to the Reducer s.
String	getRaw(String name) Get the value of the `name` property, without doing variable expansion.If the key is deprecated, it returns the value of the first key which replaces the deprecated key and is not null.
Class	getReducerClass() Get the Reducer class for the job.
URL	getResource(String name) Get the URL for the named resource.
boolean	getSpeculativeExecution() Should speculative execution be used for this job?
Collection	getStringCollection(String name) Get the comma delimited values of the `name` property as a collection of `String`s.
String[]	getStrings(String name) Get the comma delimited values of the `name` property as an array of `String`s.
String	getTrimmed(String name) Get the value of the `name` property as a trimmed `String`, `null` if no such property exists.
boolean	getUseNewMapper() Should the framework use the new context-object code for running the mapper?
boolean	getUseNewReducer() Should the framework use the new context-object code for running the reducer?
String	getUser() Get the reported username for this job.
Path	getWorkingDirectory() Get the current working directory for the default file system.
Iterator>	iterator() Get an Iterator to go through the list of `String` key-value pairs in the configuration.
void	readFields(DataInput in)
void	reloadConfiguration() Reload configuration from previously added resources.
void	set(String name, String value) Set the `value` of the `name` property.
void	set(String name, String value, String source) Set the `value` of the `name` property.
void	setBoolean(String name, boolean value) Set the value of the `name` property to a `boolean`.
void	setBooleanIfUnset(String name, boolean value) Set the given property, if it is currently unset.
void	setClass(String name, Class theClass, Class xface) Set the value of the `name` property to the name of a `theClass` implementing the given interface `xface`.
void	setClassLoader(ClassLoader classLoader) Set the class loader that will be used to load the various objects.
void	setCombinerClass(Class theClass) Set the user-defined combiner class used to combine map-outputs before being sent to the reducers.
void	setCompressMapOutput(boolean compress) Should the map outputs be compressed before transfer?
void	setCredentials(Credentials credentials)
void	setEnum(String name, T value) Set the value of the `name` property to the given type.
void	setFloat(String name, float value) Set the value of the `name` property to a `float`.
void	setInputFormat(Class theClass) Set the InputFormat implementation for the map-reduce job.
void	setInt(String name, int value) Set the value of the `name` property to an `int`.
void	setJar(String jar) Set the user jar for the map-reduce job.
void	setJarByClass(Class cls) Set the job's jar file by finding an example class location.
void	setJobName(String name) Set the user-specified job name.
void	setJobPriority(JobPriority prio) Set JobPriority for this job.
void	setKeepFailedTaskFiles(boolean keep) Set whether the framework should keep the intermediate files for failed tasks.
void	setKeyFieldComparatorOptions(String keySpec) Set the KeyFieldBasedComparator options used to compare keys.
void	setKeyFieldPartitionerOptions(String keySpec) Set the KeyFieldBasedPartitioner options used for Partitioner
void	setLong(String name, long value) Set the value of the `name` property to a `long`.
void	setMapOutputCompressorClass(Class codecClass) Set the given class as the CompressionCodec for the map outputs.
void	setMapOutputKeyClass(Class theClass) Set the key class for the map output data.
void	setMapOutputValueClass(Class theClass) Set the value class for the map output data.
void	setMapperClass(Class theClass) Set the Mapper class for the job.
void	setMapRunnerClass(Class theClass) Expert: Set the MapRunnable class for the job.
void	setMapSpeculativeExecution(boolean speculativeExecution) Turn speculative execution on or off for this job for map tasks.
void	setMaxMapAttempts(int n) Expert: Set the number of maximum attempts that will be made to run a map task.
void	setMaxReduceAttempts(int n) Expert: Set the number of maximum attempts that will be made to run a reduce task.
void	setMemoryForMapTask(long mem)
void	setMemoryForReduceTask(long mem)
void	setNumMapTasks(int n) Set the number of map tasks for this job.
void	setNumReduceTasks(int n) Set the requisite number of reduce tasks for this job.
void	setNumTasksToExecutePerJvm(int numTasks) Sets the number of tasks that a spawned task JVM should run before it exits
void	setOutputCommitter(Class theClass) Set the OutputCommitter implementation for the map-reduce job.
void	setOutputFormat(Class theClass) Set the OutputFormat implementation for the map-reduce job.
void	setOutputKeyClass(Class theClass) Set the key class for the job output data.
void	setOutputKeyComparatorClass(Class theClass) Set the RawComparator comparator used to compare keys.
void	setOutputValueClass(Class theClass) Set the value class for job outputs.
void	setOutputValueGroupingComparator(Class theClass) Set the user defined RawComparator comparator for grouping keys in the input to the reduce.
void	setPartitionerClass(Class theClass) Set the Partitioner class used to partition Mapper -outputs to be sent to the Reducer s.
void	setReducerClass(Class theClass) Set the Reducer class for the job.
void	setReduceSpeculativeExecution(boolean speculativeExecution) Turn speculative execution on or off for this job for reduce tasks.
void	setSpeculativeExecution(boolean speculativeExecution) Turn speculative execution on or off for this job.
void	setStrings(String name, String... values) Set the array of string values for the `name` property as as comma delimited values.
void	setUseNewMapper(boolean flag) Set whether the framework should use the new api for the mapper.
void	setUseNewReducer(boolean flag) Set whether the framework should use the new api for the reducer.
void	setUser(String user) Set the reported username for this job.
void	setWorkingDirectory(Path dir) Set the current working directory for the default file system.
void	unset(String name) Unset a previously set property.
void	write(DataOutput out)
void	writeXml(OutputStream out) Write out the non-default properties in this configuration to the given OutputStream using UTF-8 encoding.