com.intel.hadoop.graphbuilder.idnormalize.mapreduce
Class TransEdgeReducer<VidType extends org.apache.hadoop.io.WritableComparable<VidType>>
java.lang.Object
org.apache.hadoop.mapred.MapReduceBase
com.intel.hadoop.graphbuilder.idnormalize.mapreduce.TransEdgeReducer<VidType>
- Type Parameters:
VidType
-
- All Implemented Interfaces:
- java.io.Closeable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>
public class TransEdgeReducer<VidType extends org.apache.hadoop.io.WritableComparable<VidType>>
- extends org.apache.hadoop.mapred.MapReduceBase
- implements org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>
This reducer class takes from mapper the input (h(v), [(D(u_i),v_i,
data)...]) and output (D(u_i), D(v_i), data). Because the key is based on
hash of the rawId, the loading of dictionary is minimized.
Method Summary |
void |
configure(org.apache.hadoop.mapred.JobConf conf)
|
void |
reduce(org.apache.hadoop.io.IntWritable key,
java.util.Iterator<org.apache.hadoop.io.Text> iter,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> out,
org.apache.hadoop.mapred.Reporter reporter)
|
Methods inherited from class org.apache.hadoop.mapred.MapReduceBase |
close |
Methods inherited from class java.lang.Object |
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Methods inherited from interface java.io.Closeable |
close |
TransEdgeReducer
public TransEdgeReducer()
configure
public void configure(org.apache.hadoop.mapred.JobConf conf)
- Specified by:
configure
in interface org.apache.hadoop.mapred.JobConfigurable
- Overrides:
configure
in class org.apache.hadoop.mapred.MapReduceBase
reduce
public void reduce(org.apache.hadoop.io.IntWritable key,
java.util.Iterator<org.apache.hadoop.io.Text> iter,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text> out,
org.apache.hadoop.mapred.Reporter reporter)
throws java.io.IOException
- Specified by:
reduce
in interface org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>
- Throws:
java.io.IOException