com.ebay.erl.mobius.core.mapred
Class MultiInputsHelper

java.lang.Object
  extended by com.ebay.erl.mobius.core.mapred.MultiInputsHelper
Direct Known Subclasses:
FileInputFormatHelper

public abstract class MultiInputsHelper
extends java.lang.Object

This product is licensed under the Apache License, Version 2.0, available at http://www.apache.org/licenses/LICENSE-2.0. This product contains portions derived from Apache hadoop which is licensed under the Apache License, Version 2.0, available at http://hadoop.apache.org. © 2007 – 2012 eBay Inc., Evan Chiu, Woody Zhou, Neel Sundaresan


Constructor Summary
MultiInputsHelper()
           
 
Method Summary
abstract  java.net.URI getPathBySplit(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf conf)
          Get the URI to for Mobius to identify the current dataset ID.
abstract  java.net.URI getUniquePathByInputFormat(org.apache.hadoop.mapred.JobConf conf, org.apache.hadoop.fs.Path anInput)
          Get a unique URI so that Mobius can use the URI to locate the corresponding Dataset.
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

MultiInputsHelper

public MultiInputsHelper()
Method Detail

getUniquePathByInputFormat

public abstract java.net.URI getUniquePathByInputFormat(org.apache.hadoop.mapred.JobConf conf,
                                                        org.apache.hadoop.fs.Path anInput)
                                                 throws java.io.IOException
Get a unique URI so that Mobius can use the URI to locate the corresponding Dataset.

Parameters:
conf -
anInput -
mapperClass -
Returns:
Throws:
java.io.IOException

getPathBySplit

public abstract java.net.URI getPathBySplit(org.apache.hadoop.mapred.InputSplit split,
                                            org.apache.hadoop.mapred.JobConf conf)
                                     throws java.io.IOException
Get the URI to for Mobius to identify the current dataset ID. Return null if the split cannot be handled by this helper.

Parameters:
split -
conf -
Returns:
Throws:
java.io.IOException