com.ebay.erl.mobius.core.mapred
Class MobiusInputSampler
java.lang.Object
com.ebay.erl.mobius.core.mapred.MobiusInputSampler
- All Implemented Interfaces:
- InputSampler.Sampler
public class MobiusInputSampler
- extends java.lang.Object
- implements InputSampler.Sampler
Performing sampling for total sort job.
This product is licensed under the Apache License, Version 2.0,
available at http://www.apache.org/licenses/LICENSE-2.0.
This product contains portions derived from Apache hadoop which is
licensed under the Apache License, Version 2.0, available at
http://hadoop.apache.org.
© 2007 – 2012 eBay Inc., Evan Chiu, Woody Zhou, Neel Sundaresan
Method Summary |
java.lang.Object[] |
getSample(org.apache.hadoop.mapred.InputFormat inf,
org.apache.hadoop.mapred.JobConf job)
For a given job, collect and return a subset of the keys from the
input data. |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
MobiusInputSampler
public MobiusInputSampler(double freq,
int numSamples,
int maxSplitsSampled)
getSample
public java.lang.Object[] getSample(org.apache.hadoop.mapred.InputFormat inf,
org.apache.hadoop.mapred.JobConf job)
throws java.io.IOException
- Description copied from interface:
InputSampler.Sampler
- For a given job, collect and return a subset of the keys from the
input data.
- Specified by:
getSample
in interface InputSampler.Sampler
- Throws:
java.io.IOException