|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectcom.intel.hadoop.graphbuilder.partition.mapreduce.edge.EdgeIngressMR
public class EdgeIngressMR
The MapRedue class takes from input directory a list of edges and vertices, and output 2 parts: partitioned graphs and a list of distributed vertex records.
Input directory: Can take multiple input directories containing list of edges. Output directory structure:
Nested Class Summary | |
---|---|
static class |
EdgeIngressMR.COUNTER
MapReduce Job Counters. |
Constructor Summary | |
---|---|
EdgeIngressMR(java.lang.Class graphparser,
java.lang.Class vidparser,
java.lang.Class vdataparser,
java.lang.Class edataparser)
Default constructor, initialize with parsers. |
Method Summary | |
---|---|
org.apache.hadoop.mapred.JobConf |
getConf()
|
void |
run(java.lang.String[] inputpaths,
java.lang.String outputpath,
int numProcs,
java.lang.String ingress)
|
void |
setIngress(java.lang.String ingress)
Set the ingress strategy {random, oblivious}. |
void |
setJobName(java.lang.String name)
Set the job name. |
void |
setKeyValueClass(java.lang.Class keyClass,
java.lang.Class valClass)
Set the intermediate key value class. |
void |
setParser(java.lang.Class graphparser,
java.lang.Class vidparser,
java.lang.Class vdataparser,
java.lang.Class edataparser)
Set the parser class. |
void |
setTotalSubPartition(int n)
Set the number of subpartitions per real partition. |
void |
useGzip(boolean gzip)
Set option for using gzip compression in output. |
Methods inherited from class java.lang.Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public EdgeIngressMR(java.lang.Class graphparser, java.lang.Class vidparser, java.lang.Class vdataparser, java.lang.Class edataparser)
graphparser
- vidparser
- vdataparser
- edataparser
- Method Detail |
---|
public void setParser(java.lang.Class graphparser, java.lang.Class vidparser, java.lang.Class vdataparser, java.lang.Class edataparser)
parser
- public void setJobName(java.lang.String name)
name
- public void useGzip(boolean gzip)
gzip
- public void setIngress(java.lang.String ingress)
ingress
- {ObliviousIngress}
,
{RandomIngress}
public void setKeyValueClass(java.lang.Class keyClass, java.lang.Class valClass)
keyClass
- valClass
- public org.apache.hadoop.mapred.JobConf getConf()
public void run(java.lang.String[] inputpaths, java.lang.String outputpath, int numProcs, java.lang.String ingress) throws java.io.IOException
inputpath
- outputpath
- numProcs
- ingress
-
java.io.IOException
public void setTotalSubPartition(int n)
n
- number of subpartitions per real partition.
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |