com.ebay.erl.mobius.core.mapred
Class MultiInputsHelper
java.lang.Object
com.ebay.erl.mobius.core.mapred.MultiInputsHelper
- Direct Known Subclasses:
- FileInputFormatHelper
public abstract class MultiInputsHelper
- extends java.lang.Object
This product is licensed under the Apache License, Version 2.0,
available at http://www.apache.org/licenses/LICENSE-2.0.
This product contains portions derived from Apache hadoop which is
licensed under the Apache License, Version 2.0, available at
http://hadoop.apache.org.
© 2007 – 2012 eBay Inc., Evan Chiu, Woody Zhou, Neel Sundaresan
Method Summary |
abstract java.net.URI |
getPathBySplit(org.apache.hadoop.mapred.InputSplit split,
org.apache.hadoop.mapred.JobConf conf)
Get the URI to for Mobius to identify the current dataset ID. |
abstract java.net.URI |
getUniquePathByInputFormat(org.apache.hadoop.mapred.JobConf conf,
org.apache.hadoop.fs.Path anInput)
Get a unique URI so that Mobius can use the URI to locate the
corresponding Dataset . |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
MultiInputsHelper
public MultiInputsHelper()
getUniquePathByInputFormat
public abstract java.net.URI getUniquePathByInputFormat(org.apache.hadoop.mapred.JobConf conf,
org.apache.hadoop.fs.Path anInput)
throws java.io.IOException
- Get a unique
URI
so that Mobius can use the URI to locate the
corresponding Dataset
.
- Parameters:
conf
- anInput
- mapperClass
-
- Returns:
-
- Throws:
java.io.IOException
getPathBySplit
public abstract java.net.URI getPathBySplit(org.apache.hadoop.mapred.InputSplit split,
org.apache.hadoop.mapred.JobConf conf)
throws java.io.IOException
- Get the URI to for Mobius to identify the current dataset ID. Return null
if the
split
cannot be handled by this helper.
- Parameters:
split
- conf
-
- Returns:
-
- Throws:
java.io.IOException