Example usage for Java org.apache.hadoop.mapreduce Job fields, constructors, methods, implement or subclass
The text is from its open source code.
| String | SUBMIT_REPLICATION |
| Job(Configuration conf, String jobName) | |
| Job(JobStatus status, JobConf conf) | |
| Job(Configuration conf) | |
| Job(JobConf conf) | |
| Job() |
| void | addArchiveToClassPath(Path archive) Add an archive path to the current set of classpath entries. |
| void | addCacheArchive(URI uri) Add a archives to be localized |
| void | addCacheFile(URI uri) Add a file to be localized |
| void | addFileToClassPath(Path file) Add an file path to the current set of classpath entries It adds the file to cache as well. |
| void | createSymlink() Originally intended to enable symlinks, but currently symlinks cannot be disabled. |
| URI[] | getCacheArchives() Get cache archives set in the Configuration |
| URI[] | getCacheFiles() Get cache files set in the Configuration |
| Cluster | getCluster() |
| Class> | getCombinerClass() Get the combiner class for the job. |
| Configuration | getConfiguration() Return the configuration for the job. |
| Counters | getCounters() Gets the counters for this job. |
| Credentials | getCredentials() |
| long | getFinishTime() Get finish time of the job. |
| RawComparator | getGroupingComparator() Get the user defined RawComparator comparator for grouping keys of inputs to the reduce. |
| Class> | getInputFormatClass() Get the InputFormat class for the job. |
| Job | getInstance(Configuration conf, String jobName) Creates a new Job with no particular Cluster and a given jobName. |
| Job | getInstance(JobStatus status, Configuration conf) Creates a new Job with no particular Cluster and given Configuration and JobStatus . |
| Job | getInstance(Cluster ignored, Configuration conf) Creates a new Job with no particular Cluster and given Configuration . |
| Job | getInstance(Configuration conf) Creates a new Job with no particular Cluster and a given Configuration . |
| Job | getInstance(Cluster ignored) Creates a new Job with no particular Cluster . |
| Job | getInstance() Creates a new Job with no particular Cluster . |
| String | getJar() Get the pathname of the job's jar. |
| String | getJobFile() Get the path of the submitted job configuration. |
| JobID | getJobID() Get the unique ID for the job. |
| String | getJobName() The user-specified job name. |
| JobStatus.State | getJobState() Returns the current state of the Job. |
| Class | getMapOutputKeyClass() Get the key class for the map output data. |
| Class | getMapOutputValueClass() Get the value class for the map output data. |
| Class> | getMapperClass() Get the Mapper class for the job. |
| int | getNumReduceTasks() Get configured the number of reduce tasks for this job. |
| Class> | getOutputFormatClass() Get the OutputFormat class for the job. |
| Class | getOutputKeyClass() Get the key class for the job output data. |
| Class | getOutputValueClass() Get the value class for job outputs. |
| Class> | getPartitionerClass() Get the Partitioner class for the job. |
| Class> | getReducerClass() Get the Reducer class for the job. |
| RawComparator | getSortComparator() Get the RawComparator comparator used to compare keys. |
| long | getStartTime() Get start time of the job. |
| JobStatus | getStatus() |
| org.apache.hadoop.mapred.TaskCompletionEvent[] | getTaskCompletionEvents(final int startFrom) Get events indicating completion (success/failure) of component tasks. |
| TaskCompletionEvent[] | getTaskCompletionEvents(final int startFrom, final int numEvents) Get events indicating completion (success/failure) of component tasks. |
| String[] | getTaskDiagnostics(final TaskAttemptID taskid) Gets the diagnostic messages for a given task attempt. |
| TaskReport[] | getTaskReports(TaskType type) Get the information of the current state of the tasks of a job. |
| String | getTrackingURL() Get the URL where some job progress information will be displayed. |
| Path | getWorkingDirectory() Get the current working directory for the default file system. |
| boolean | isComplete() Check if the job is finished or not. |
| boolean | isRetired() |
| boolean | isSuccessful() Check if the job completed successfully. |
| void | killJob() Kill the running job. |
| float | mapProgress() Get the progress of the job's map-tasks, as a float between 0.0 and 1.0. |
| boolean | monitorAndPrintJob() Monitor a job and print status in real-time as progress is made and tasks fail. |
| float | reduceProgress() Get the progress of the job's reduce-tasks, as a float between 0.0 and 1.0. |
| void | setCombinerClass(Class cls) Set the combiner class for the job. |
| void | setCombinerKeyGroupingComparatorClass(Class cls) Define the comparator that controls which keys are grouped together for a single call to combiner, Reducer#reduce(Object,Iterable,org.apache.hadoop.mapreduce.Reducer.Context) |
| void | setGroupingComparatorClass(Class cls) Define the comparator that controls which keys are grouped together for a single call to Reducer#reduce(Object,Iterable,org.apache.hadoop.mapreduce.Reducer.Context) |
| void | setInputFormatClass(Class cls) Set the InputFormat for the job. |
| void | setJar(String jar) Set the job jar |
| void | setJarByClass(Class cls) Set the Jar by finding where a given class came from. |
| void | setJobID(JobID jobId) Set the JobID. |
| void | setJobName(String name) Set the user-specified job name. |
| void | setMapOutputKeyClass(Class theClass) Set the key class for the map output data. |
| void | setMapOutputValueClass(Class theClass) Set the value class for the map output data. |
| void | setMapperClass(Class cls) Set the Mapper for the job. |
| void | setMapSpeculativeExecution(boolean speculativeExecution) Turn speculative execution on or off for this job for map tasks. |
| void | setMaxMapAttempts(int n) Expert: Set the number of maximum attempts that will be made to run a map task. |
| void | setMaxReduceAttempts(int n) Expert: Set the number of maximum attempts that will be made to run a reduce task. |
| void | setNumReduceTasks(int tasks) Set the number of reduce tasks for the job. |
| void | setOutputFormatClass(Class cls) Set the OutputFormat for the job. |
| void | setOutputKeyClass(Class theClass) Set the key class for the job output data. |
| void | setOutputValueClass(Class theClass) Set the value class for job outputs. |
| void | setPartitionerClass(Class cls) Set the Partitioner for the job. |
| void | setReducerClass(Class cls) Set the Reducer for the job. |
| void | setReduceSpeculativeExecution(boolean speculativeExecution) Turn speculative execution on or off for this job for reduce tasks. |
| void | setSortComparatorClass(Class cls) Define the comparator that controls how the keys are sorted before they are passed to the Reducer . |
| void | setSpeculativeExecution(boolean speculativeExecution) Turn speculative execution on or off for this job. |
| float | setupProgress() Get the progress of the job's setup-tasks, as a float between 0.0 and 1.0. |
| void | setWorkingDirectory(Path dir) Set the current working directory for the default file system. |
| void | submit() Submit the job to the cluster and return immediately. |
| String | toString() Dump stats to screen. |
| boolean | waitForCompletion(boolean verbose) Submit the job to the cluster and wait for it to finish. |