|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Dataset | |
---|---|
com.ebay.erl.mobius.core | Contains the main class MobiusJob of
the Mobius core API; refer to MobiusJob to
see how to create an analysis flow using
Mobius. |
com.ebay.erl.mobius.core.builder | Provides built-in builders to build Datasets. |
com.ebay.erl.mobius.core.function | Provides varies of aggregation or grouping
functions such as Counts
or Max . |
com.ebay.erl.mobius.core.function.base | Provides base classes for implementing different kinds of aggregation functions. |
com.ebay.erl.mobius.core.model | Provides classes representing tje Mobius
data model, such as Tuple or
Column . |
Uses of Dataset in com.ebay.erl.mobius.core |
---|
Methods in com.ebay.erl.mobius.core that return Dataset | |
---|---|
Dataset |
Persistable.build(MobiusJob job,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
Projectable... projections)
Build the dataset and store the projections
into a temporal path (under hadoop.tmp.dir) in the format of
the given outputFormat . |
Dataset |
Persistable.build(MobiusJob job,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
TupleCriterion criteria,
Projectable... projections)
Build the dataset and store the projections
into a temporal path (under hadoop.tmp.dir) in the format of
SequenceFileOutputFormat . |
Dataset |
Persistable.build(MobiusJob job,
Projectable... projections)
Build the dataset and store the projections
into a temporal path (under hadoop.tmp.dir) in the format of
SequenceFileOutputFormat . |
Dataset |
Persistable.build(MobiusJob job,
TupleCriterion criteria,
Projectable... projections)
Build the dataset and store the projections
into a temporal path (under hadoop.tmp.dir) in the format of
SequenceFileOutputFormat . |
Dataset |
MobiusJob.list(Dataset dataset,
Column... columns)
Select the columns from the dataset . |
Dataset |
MobiusJob.list(Dataset dataset,
org.apache.hadoop.fs.Path outputFolder,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
Column... columns)
Select the columns from the dataset , store
it into outputFolder with the given outputFormat |
Dataset |
MobiusJob.list(Dataset dataset,
org.apache.hadoop.fs.Path outputFolder,
Column... columns)
Select the columns from the dataset and store
it into outputFolder . |
Dataset |
SortPersistable.save(MobiusJob job,
org.apache.hadoop.fs.Path output)
Save the sort result to the given output . |
Dataset |
SortPersistable.save(MobiusJob job,
org.apache.hadoop.fs.Path output,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat)
Save the sort result to the given output with
the specified outputFormat . |
Dataset |
Persistable.save(MobiusJob job,
org.apache.hadoop.fs.Path output,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
Projectable... projections)
Save the dataset and store the projections
into a the specified output path in the
format of the given outputFormat . |
Dataset |
Persistable.save(MobiusJob job,
org.apache.hadoop.fs.Path output,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
TupleCriterion criteria,
Projectable... projections)
Save the dataset and store the projections
into a the specified output path in the
format of the given outputFormat . |
Dataset |
Persistable.save(MobiusJob job,
org.apache.hadoop.fs.Path output,
Projectable... projections)
Save the dataset and store the projections
into a the specified output path in the
format of TextOutputFormat . |
Dataset |
Persistable.save(MobiusJob job,
org.apache.hadoop.fs.Path output,
TupleCriterion criteria,
Projectable... projections)
Save the dataset and store the projections
into a the specified output path in the
format of TextOutputFormat . |
Methods in com.ebay.erl.mobius.core with parameters of type Dataset | |
---|---|
GroupByConfigure |
MobiusJob.group(Dataset aDataset)
Start a group-by job. |
JoinOnConfigure |
MobiusJob.innerJoin(Dataset... datasets)
Perform inner join on the given datasets . |
JoinOnConfigure |
MobiusJob.leftOuterJoin(Dataset left,
Dataset right)
Performing "Left Outer Join", the result contains all the records of the left Dataset (the 1st Dataset) with or without match to the right Dataset. |
JoinOnConfigure |
MobiusJob.leftOuterJoin(Dataset left,
Dataset right,
java.lang.Object nullReplacement)
Performing "Left Outer Join", the result contains all the records of the left Dataset (the 1st Dataset) with or without match to the right Dataset. |
Dataset |
MobiusJob.list(Dataset dataset,
Column... columns)
Select the columns from the dataset . |
Dataset |
MobiusJob.list(Dataset dataset,
org.apache.hadoop.fs.Path outputFolder,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
Column... columns)
Select the columns from the dataset , store
it into outputFolder with the given outputFormat |
Dataset |
MobiusJob.list(Dataset dataset,
org.apache.hadoop.fs.Path outputFolder,
Column... columns)
Select the columns from the dataset and store
it into outputFolder . |
JoinOnConfigure |
MobiusJob.rightOuterJoin(Dataset left,
Dataset right)
Performing "Right Outer Join", the result contains all the records of the right Dataset (the 2nd argument) with or without match to the left Dataset. |
JoinOnConfigure |
MobiusJob.rightOuterJoin(Dataset left,
Dataset right,
java.lang.Object nullReplacement)
Performing "Right Outer Join", the result contains all the records of the right Dataset (the 2nd argument) with or without match to the left Dataset. |
SortProjectionConfigure |
MobiusJob.sort(Dataset aDataset)
Performing a total sort on the aDataset. |
Uses of Dataset in com.ebay.erl.mobius.core.builder |
---|
Subclasses of Dataset in com.ebay.erl.mobius.core.builder | |
---|---|
class |
SeqFileDataset
Represents a dataset backed with Hadoop sequence file format. |
class |
TSVDataset
Represents a dataset backed with the Hadoop text format. |
Methods in com.ebay.erl.mobius.core.builder that return Dataset | |
---|---|
Dataset |
AbstractDatasetBuilder.build()
Finishing the Dataset building process. |
Dataset |
TSVDatasetBuilder.buildFromPreviousJob(org.apache.hadoop.mapred.JobConf prevJob,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> prevJobOutputFormat,
java.lang.String[] schema)
To be called by Mobius engine, for building a dataset from a previous mobius job, user should not use this method. |
Dataset |
SeqFileDatasetBuilder.buildFromPreviousJob(org.apache.hadoop.mapred.JobConf prevJob,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> prevJobOutputFormat,
java.lang.String[] schema)
To be called by Mobius engine, for building a dataset from a previous mobius job, user should not use this method. |
Dataset |
AbstractDatasetBuilder.buildFromPreviousJob(org.apache.hadoop.mapred.JobConf prevJob,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> prevJobOutputFormat,
java.lang.String[] schema)
To be called by Mobius engine, for building a dataset from a previous mobius job, user should not use this method. |
protected Dataset |
AbstractDatasetBuilder.getDataset()
Get the AbstractDatasetBuilder.dataset , if it's null,
then AbstractDatasetBuilder.newDataset(String) will be called
and assign AbstractDatasetBuilder.dataset to the return object. |
protected Dataset |
TSVDatasetBuilder.newDataset(java.lang.String datasetName)
|
protected Dataset |
SeqFileDatasetBuilder.newDataset(java.lang.String datasetName)
Create a new Dataset , the returned Dataset
has no state at all (no paths, constraints...etc.) |
protected abstract Dataset |
AbstractDatasetBuilder.newDataset(java.lang.String datasetName)
Create a new Dataset , the returned Dataset
has no state at all (no paths, constraints...etc.) |
Dataset |
Dataset.orderBy(java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputformat,
Sorter... sorters)
Sort this Dataset by the given sorters . |
Dataset |
Dataset.orderBy(org.apache.hadoop.fs.Path output,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputformat,
Sorter... sorters)
Sort this Dataset by the given sorters . |
Dataset |
Dataset.orderBy(org.apache.hadoop.fs.Path output,
Sorter... sorters)
Sort this Dataset by the given sorters . |
Dataset |
Dataset.orderBy(Sorter... sorters)
Sort this Dataset by the given sorters . |
Uses of Dataset in com.ebay.erl.mobius.core.function |
---|
Constructors in com.ebay.erl.mobius.core.function with parameters of type Dataset | |
---|---|
Top(Dataset ds,
java.lang.String[] inputColumns,
int topX)
Create a Top operation that emit up to
topX rows from the given dataset
ds . |
|
Top(Dataset ds,
java.lang.String[] inputColumns,
int topX,
java.lang.Class<? extends java.util.Comparator<Tuple>> comparator)
Create a Top operation that emit up to
topX rows from the given dataset
ds . |
Uses of Dataset in com.ebay.erl.mobius.core.function.base |
---|
Methods in com.ebay.erl.mobius.core.function.base that return types with arguments of type Dataset | |
---|---|
java.util.Set<Dataset> |
Projectable.getParticipatedDataset()
return the Dataset that is required in computing
the result of this function. |
Uses of Dataset in com.ebay.erl.mobius.core.model |
---|
Fields in com.ebay.erl.mobius.core.model declared as Dataset | |
---|---|
protected Dataset |
Column.dataset
the Dataset this column belongs to. |
Methods in com.ebay.erl.mobius.core.model that return Dataset | |
---|---|
Dataset |
Column.getDataset()
Get the Dataset this column belongs to. |
Methods in com.ebay.erl.mobius.core.model with parameters of type Dataset | |
---|---|
static Column[] |
Column.columns(Dataset dataset,
java.lang.String... columns)
Select multiple columns from a dataset |
Constructors in com.ebay.erl.mobius.core.model with parameters of type Dataset | |
---|---|
Column(Dataset dataset,
java.lang.String columnName)
Create a column instance that represents a column named columnName in the dataset
. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |