|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectcom.ebay.erl.mobius.core.builder.Dataset
com.ebay.erl.mobius.core.builder.SeqFileDataset
public class SeqFileDataset
Represents a dataset backed with Hadoop sequence file format.
This product is licensed under the Apache License, Version 2.0, available at http://www.apache.org/licenses/LICENSE-2.0. This product contains portions derived from Apache hadoop which is licensed under the Apache License, Version 2.0, available at http://hadoop.apache.org. © 2007 – 2012 eBay Inc., Evan Chiu, Woody Zhou, Neel Sundaresan
SeqFileDatasetBuilder
,
Serialized FormField Summary |
---|
Fields inherited from class com.ebay.erl.mobius.core.builder.Dataset |
---|
computedColumns, conf, input_format, job, mapper, name, schema, tupleConstraint |
Constructor Summary | |
---|---|
protected |
SeqFileDataset(MobiusJob job,
java.lang.String name,
java.lang.Class<? extends SequenceFileMapper> mapperClass)
Creating an instance of SeqFileDataset with
SequenceFileInputFormat as its input format. |
Method Summary | |
---|---|
protected void |
setInputFormat(java.lang.Class<? extends org.apache.hadoop.mapred.InputFormat> input_format)
Always thrown UnsupportedOperationException , the
input format for this dataset is fixed to
SequenceFileInputFormat . |
protected void |
setMapper(java.lang.Class<? extends AbstractMobiusMapper> mapper)
Set the AbstractMobiusMapper for this dataset. |
Methods inherited from class com.ebay.erl.mobius.core.builder.Dataset |
---|
addComputedColumn, createJobConf, equals, getDatasetID, getInputFormat, getInputs, getMapper, getName, getSchema, hashCode, initialize, orderBy, orderBy, orderBy, orderBy, setSchema, toString, validate, withinSchema |
Methods inherited from class java.lang.Object |
---|
clone, finalize, getClass, notify, notifyAll, wait, wait, wait |
Constructor Detail |
---|
protected SeqFileDataset(MobiusJob job, java.lang.String name, java.lang.Class<? extends SequenceFileMapper> mapperClass)
SeqFileDataset
with
SequenceFileInputFormat
as its input format.
User should not create this dataset directly through
this constructor, but to use SeqFileDatasetBuilder
to build one.
job
- a Mobius job contains an analysis flow.name
- name of this datasetmapperClass
- the mapper class to parse the underline values into Tuples.Method Detail |
---|
protected void setInputFormat(java.lang.Class<? extends org.apache.hadoop.mapred.InputFormat> input_format)
UnsupportedOperationException
, the
input format for this dataset is fixed to
SequenceFileInputFormat
.
setInputFormat
in class Dataset
protected void setMapper(java.lang.Class<? extends AbstractMobiusMapper> mapper)
AbstractMobiusMapper
for this dataset.
This method is called by the corresponding implementation
of AbstractDatasetBuilder
.
mapper
must inherent SequenceFileMapper
.
setMapper
in class Dataset
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |