com.intel.hadoop.graphbuilder.idnormalize.mapreduce
Class HashIdMapper
java.lang.Object
org.apache.hadoop.mapred.MapReduceBase
com.intel.hadoop.graphbuilder.idnormalize.mapreduce.HashIdMapper
- All Implemented Interfaces:
- java.io.Closeable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>
public class HashIdMapper
- extends org.apache.hadoop.mapred.MapReduceBase
- implements org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>
This mapper class maps an (vid, vdata) pair into (lvid, (vid, vdata)) pair.
Each mapper gets fix lines of input, therefore the lvid is the relative line
offset of the record in the split, staring from 0. The split size is
configured in mapred.line.input.format.linespermap
.
Method Summary |
void |
configure(org.apache.hadoop.mapred.JobConf job)
|
void |
map(org.apache.hadoop.io.LongWritable key,
org.apache.hadoop.io.Text val,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text> out,
org.apache.hadoop.mapred.Reporter arg3)
|
Methods inherited from class org.apache.hadoop.mapred.MapReduceBase |
close |
Methods inherited from class java.lang.Object |
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Methods inherited from interface java.io.Closeable |
close |
HashIdMapper
public HashIdMapper()
configure
public void configure(org.apache.hadoop.mapred.JobConf job)
- Specified by:
configure
in interface org.apache.hadoop.mapred.JobConfigurable
- Overrides:
configure
in class org.apache.hadoop.mapred.MapReduceBase
map
public void map(org.apache.hadoop.io.LongWritable key,
org.apache.hadoop.io.Text val,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text> out,
org.apache.hadoop.mapred.Reporter arg3)
throws java.io.IOException
- Specified by:
map
in interface org.apache.hadoop.mapred.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>
- Throws:
java.io.IOException