com.intel.hadoop.graphbuilder.partition.mapreduce.edge
Class EdgeIngressMR

java.lang.Object
  extended by com.intel.hadoop.graphbuilder.partition.mapreduce.edge.EdgeIngressMR

public class EdgeIngressMR
extends java.lang.Object

The MapRedue class takes from input directory a list of edges and vertices, and output 2 parts: partitioned graphs and a list of distributed vertex records.

Input directory: Can take multiple input directories containing list of edges. Output directory structure:


Nested Class Summary
static class EdgeIngressMR.COUNTER
          MapReduce Job Counters.
 
Constructor Summary
EdgeIngressMR(java.lang.Class graphparser, java.lang.Class vidparser, java.lang.Class vdataparser, java.lang.Class edataparser)
          Default constructor, initialize with parsers.
 
Method Summary
 org.apache.hadoop.mapred.JobConf getConf()
           
 void run(java.lang.String[] inputpaths, java.lang.String outputpath, int numProcs, java.lang.String ingress)
           
 void setIngress(java.lang.String ingress)
          Set the ingress strategy {random, oblivious}.
 void setJobName(java.lang.String name)
          Set the job name.
 void setKeyValueClass(java.lang.Class keyClass, java.lang.Class valClass)
          Set the intermediate key value class.
 void setParser(java.lang.Class graphparser, java.lang.Class vidparser, java.lang.Class vdataparser, java.lang.Class edataparser)
          Set the parser class.
 void setTotalSubPartition(int n)
          Set the number of subpartitions per real partition.
 void useGzip(boolean gzip)
          Set option for using gzip compression in output.
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

EdgeIngressMR

public EdgeIngressMR(java.lang.Class graphparser,
                     java.lang.Class vidparser,
                     java.lang.Class vdataparser,
                     java.lang.Class edataparser)
Default constructor, initialize with parsers.

Parameters:
graphparser -
vidparser -
vdataparser -
edataparser -
Method Detail

setParser

public void setParser(java.lang.Class graphparser,
                      java.lang.Class vidparser,
                      java.lang.Class vdataparser,
                      java.lang.Class edataparser)
Set the parser class.

Parameters:
parser -

setJobName

public void setJobName(java.lang.String name)
Set the job name.

Parameters:
name -

useGzip

public void useGzip(boolean gzip)
Set option for using gzip compression in output.

Parameters:
gzip -

setIngress

public void setIngress(java.lang.String ingress)
Set the ingress strategy {random, oblivious}.

Parameters:
ingress -
See Also:
{ObliviousIngress}, {RandomIngress}

setKeyValueClass

public void setKeyValueClass(java.lang.Class keyClass,
                             java.lang.Class valClass)
Set the intermediate key value class.

Parameters:
keyClass -
valClass -

getConf

public org.apache.hadoop.mapred.JobConf getConf()
Returns:
JobConf of the current job.

run

public void run(java.lang.String[] inputpaths,
                java.lang.String outputpath,
                int numProcs,
                java.lang.String ingress)
         throws java.io.IOException
Parameters:
inputpath -
outputpath -
numProcs -
ingress -
Throws:
java.io.IOException

setTotalSubPartition

public void setTotalSubPartition(int n)
Set the number of subpartitions per real partition.

Parameters:
n - number of subpartitions per real partition.