|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectcom.intel.hadoop.graphbuilder.job.AbstractEdgeTransformJob<VidType,EdgeData,TransformedEdata>
VidType
- VertexData
- EdgeData
- public abstract class AbstractEdgeTransformJob<VidType extends org.apache.hadoop.io.WritableComparable<VidType>,EdgeData extends org.apache.hadoop.io.Writable,TransformedEdata extends org.apache.hadoop.io.Writable>
An abstract wrapper class for running the Edge Transformation Job, see
EdgeTransformMR
. An example to use this class to transform word count
into word frequency is illustrated in EdgeTransformJobTest
.
User will need to override 2 functions for type resolving: vidClass()
, and edataClass()
. User will also need to implement their reduce and
apply Function
s, and override reduceFunction()
, and
applyFunction()
.
Additional options can be added into the jobConf by calling
addUserOpt
. Functional
s can get option using
configure(JobConf)
.
Additional options can be added into the jobConf by calling
addUserOpt
. Functional
s can get option using
configure(JobConf)
.
Input directory: list of edge data Output directory: list of transformed edge data
EdgeTransformMR.SOURCE
,
EdgeTransformMR.TARGET
,
EdgeTransformMR
,
Functional
,
EdgeTransformJobTest
Constructor Summary | |
---|---|
AbstractEdgeTransformJob()
|
Method Summary | |
---|---|
void |
addUserOpt(java.lang.String key,
java.lang.String value)
|
abstract Functional<EdgeData,TransformedEdata> |
applyFunction()
|
abstract java.lang.Class |
edataClass()
|
java.lang.Class |
graphParserClass()
|
abstract Functional<EdgeData,TransformedEdata> |
reduceFunction()
|
boolean |
run(boolean reduceEndPoint,
java.lang.String input,
java.lang.String output)
Running the transformation by grouping edges based on the reduceEndPoint which is either EdgeTransformMR.SOURCE or
EdgeTransFormMR.TARGET . |
abstract java.lang.Class |
vidClass()
|
Methods inherited from class java.lang.Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public AbstractEdgeTransformJob()
Method Detail |
---|
public abstract java.lang.Class vidClass()
public abstract java.lang.Class edataClass()
public abstract Functional<EdgeData,TransformedEdata> reduceFunction()
public abstract Functional<EdgeData,TransformedEdata> applyFunction()
public java.lang.Class graphParserClass()
public void addUserOpt(java.lang.String key, java.lang.String value)
public boolean run(boolean reduceEndPoint, java.lang.String input, java.lang.String output) throws javassist.NotFoundException, java.lang.InstantiationException, java.lang.IllegalAccessException, javassist.CannotCompileException
reduceEndPoint
which is either EdgeTransformMR.SOURCE
or
EdgeTransFormMR.TARGET
.
reduceEndPoint
- input
- output
-
javassist.NotFoundException
java.lang.InstantiationException
java.lang.IllegalAccessException
javassist.CannotCompileException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |