org.apache.hadoop.mapred

Class ReduceTask

java.lang.Object

org.apache.hadoop.mapred.Task

org.apache.hadoop.mapred.ReduceTask

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.io.Writable

@InterfaceAudience.Private
@InterfaceStability.Unstable
public class ReduceTask
extends Task

A Reduce task.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ReduceTask.ReduceCopier<K,V>

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.Task

Task.CombineOutputCollector<K,V>, Task.CombinerRunner<K,V>, Task.CombineValuesIterator<KEY,VALUE>, Task.Counter, Task.NewCombinerRunner<K,V>, Task.OldCombinerRunner<K,V>, Task.TaskReporter

Field Summary

Fields inherited from class org.apache.hadoop.mapred.Task

committer, conf, DEFAULT_MR_COMBINE_RECORDS_BEFORE_PROGRESS, FILESYSTEM_COUNTER_GROUP, jobCleanup, jobContext, jobRunStateForCleanup, jobSetup, jvmContext, lDirAlloc, mapOutputFile, MR_COMBINE_RECORDS_BEFORE_PROGRESS, outputFormat, PROGRESS_INTERVAL, spilledRecordsCounter, taskCleanup, taskContext, tokenSecret, umbilical

Constructor Summary

Constructors

Constructor and Description
ReduceTask()
ReduceTask(String jobFile, TaskAttemptID taskId, int partition, int numMaps, int numSlotsRequired)

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapred.TaskRunner	createRunner(TaskTracker tracker, org.apache.hadoop.mapred.TaskTracker.TaskInProgress tip, org.apache.hadoop.mapred.TaskTracker.RunningJob rjob) Return an approprate thread runner for this task.
int	getNumMaps()
boolean	isMapTask()
void	localizeConfiguration(JobConf conf) Localize the given JobConf to be specific for this task.
void	readFields(DataInput in)
void	run(JobConf job, TaskUmbilicalProtocol umbilical) Run this task as a part of the named job.
void	write(DataOutput out)

Methods inherited from class org.apache.hadoop.mapred.Task

createReduceContext, done, getConf, getFileSystemCounterNames, getJobFile, getJobID, getJobTokenSecret, getJvmContext, getMapOutputFile, getNumSlotsRequired, getPartition, getPhase, getProgress, getSkipRanges, getTaskID, getUser, initialize, isSkipping, reportFatalError, reportNextRecordRange, runJobCleanupTask, runJobSetupTask, runTaskCleanupTask, setConf, setJobFile, setJobTokenSecret, setJvmContext, setPhase, setSkipping, setSkipRanges, setWriteSkipRecs, statusUpdate, supportIsolationRunner, toString, toWriteSkipRecs, writeFilesRequiredForRerun

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ReduceTask

public ReduceTask()

ReduceTask

public ReduceTask(String jobFile,
          TaskAttemptID taskId,
          int partition,
          int numMaps,
          int numSlotsRequired)

Method Detail

createRunner

public org.apache.hadoop.mapred.TaskRunner createRunner(TaskTracker tracker,
                                               org.apache.hadoop.mapred.TaskTracker.TaskInProgress tip,
                                               org.apache.hadoop.mapred.TaskTracker.RunningJob rjob)
                                                 throws IOException

Description copied from class: Task

Return an approprate thread runner for this task.

Specified by:

createRunner in class Task

tip - TODO

Throws:

IOException

isMapTask

public boolean isMapTask()

Specified by:

isMapTask in class Task

getNumMaps

public int getNumMaps()

localizeConfiguration

public void localizeConfiguration(JobConf conf)
                           throws IOException

Localize the given JobConf to be specific for this task.

Overrides:

localizeConfiguration in class Task

Throws:

IOException

write

public void write(DataOutput out)
           throws IOException

Specified by:

write in interface org.apache.hadoop.io.Writable

Overrides:

write in class Task

Throws:

IOException

readFields

public void readFields(DataInput in)
                throws IOException

Specified by:

readFields in interface org.apache.hadoop.io.Writable

Overrides:

readFields in class Task

Throws:

IOException

run

public void run(JobConf job,
       TaskUmbilicalProtocol umbilical)
         throws IOException,
                InterruptedException,
                ClassNotFoundException

Description copied from class: Task

Run this task as a part of the named job. This method is executed in the child process and is what invokes user-supplied map, reduce, etc. methods.

Specified by:

run in class Task

umbilical - for progress reports

Throws:

IOException

InterruptedException

ClassNotFoundException