|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectcom.ebay.erl.mobius.core.Persistable
public class Persistable
Sets the projections (columns to be saved on disk ) for join or group-by jobs.
The user cannot create an instance of this class
directly. To get an instance of this class, use
JoinOnConfigure
for join type jobs, or
GroupByConfigure
for group-by jobs.
See MobiusJob.innerJoin(Dataset...)
or
MobiusJob.group(Dataset)
for information
on creating a join or group-by job.
This product is licensed under the Apache License, Version 2.0,
available at http://www.apache.org/licenses/LICENSE-2.0.
This product contains portions derived from Apache hadoop which is
licensed under the Apache License, Version 2.0, available at
http://hadoop.apache.org.
© 2007 – 2012 eBay Inc., Evan Chiu, Woody Zhou, Neel Sundaresan
Method Summary | |
---|---|
Dataset |
build(MobiusJob job,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
Projectable... projections)
Build the dataset and store the projections
into a temporal path (under hadoop.tmp.dir) in the format of
the given outputFormat . |
Dataset |
build(MobiusJob job,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
TupleCriterion criteria,
Projectable... projections)
Build the dataset and store the projections
into a temporal path (under hadoop.tmp.dir) in the format of
SequenceFileOutputFormat . |
Dataset |
build(MobiusJob job,
Projectable... projections)
Build the dataset and store the projections
into a temporal path (under hadoop.tmp.dir) in the format of
SequenceFileOutputFormat . |
Dataset |
build(MobiusJob job,
TupleCriterion criteria,
Projectable... projections)
Build the dataset and store the projections
into a temporal path (under hadoop.tmp.dir) in the format of
SequenceFileOutputFormat . |
Dataset |
save(MobiusJob job,
org.apache.hadoop.fs.Path output,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
Projectable... projections)
Save the dataset and store the projections
into a the specified output path in the
format of the given outputFormat . |
Dataset |
save(MobiusJob job,
org.apache.hadoop.fs.Path output,
java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat,
TupleCriterion criteria,
Projectable... projections)
Save the dataset and store the projections
into a the specified output path in the
format of the given outputFormat . |
Dataset |
save(MobiusJob job,
org.apache.hadoop.fs.Path output,
Projectable... projections)
Save the dataset and store the projections
into a the specified output path in the
format of TextOutputFormat . |
Dataset |
save(MobiusJob job,
org.apache.hadoop.fs.Path output,
TupleCriterion criteria,
Projectable... projections)
Save the dataset and store the projections
into a the specified output path in the
format of TextOutputFormat . |
Persistable |
setConf(java.lang.String name,
java.lang.String value)
set a configuration property to this job's configuration. |
Persistable |
setJobName(java.lang.String newJobName)
Specify the name of this job. |
Persistable |
setReducersNumber(int reducerNumber)
Specify the number of reducer of this job. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Method Detail |
---|
public Persistable setConf(java.lang.String name, java.lang.String value)
name
- a property name in a Hadoop job configuration.value
- the value for the property name in a Hadoop
job configuration.public Persistable setJobName(java.lang.String newJobName)
public Persistable setReducersNumber(int reducerNumber)
public Dataset build(MobiusJob job, Projectable... projections) throws java.io.IOException
projections
into a temporal path (under hadoop.tmp.dir) in the format of
SequenceFileOutputFormat
.
java.io.IOException
public Dataset build(MobiusJob job, TupleCriterion criteria, Projectable... projections) throws java.io.IOException
projections
into a temporal path (under hadoop.tmp.dir) in the format of
SequenceFileOutputFormat
.
Only the rows that meet the criteria
will be
stored. The criteria
can only evaluate the
columns specified in the projections
.
java.io.IOException
public Dataset build(MobiusJob job, java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat, Projectable... projections) throws java.io.IOException
projections
into a temporal path (under hadoop.tmp.dir) in the format of
the given outputFormat
.
java.io.IOException
public Dataset build(MobiusJob job, java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat, TupleCriterion criteria, Projectable... projections) throws java.io.IOException
projections
into a temporal path (under hadoop.tmp.dir) in the format of
SequenceFileOutputFormat
.
Only the rows that meet the criteria
will be
stored. The criteria
can only evaluate the
columns specified in the projections
.
job
- outputFormat
- criteria
- if specified (not null), only rows that satisfy the given criteria
will be saved. Note that, criteria
is applied just before the persistant step, so
it can only operate on the columns in the output schema of this job.projections
- the columns to be saved in the returned Dataset
.
Dataset
with the specified columns ()
java.io.IOException
public Dataset save(MobiusJob job, org.apache.hadoop.fs.Path output, Projectable... projections) throws java.io.IOException
projections
into a the specified output
path in the
format of TextOutputFormat
.
output
will be deleted before the job gets started.
java.io.IOException
public Dataset save(MobiusJob job, org.apache.hadoop.fs.Path output, TupleCriterion criteria, Projectable... projections) throws java.io.IOException
projections
into a the specified output
path in the
format of TextOutputFormat
.
Only the rows that meet the criteria
will be
stored. The criteria
can only evaluate the
columns specified in the projections
.
output
will be deleted before the job gets started.
java.io.IOException
public Dataset save(MobiusJob job, org.apache.hadoop.fs.Path output, java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat, Projectable... projections) throws java.io.IOException
projections
into a the specified output
path in the
format of the given outputFormat
.
output
will be deleted before the job gets started.
java.io.IOException
public Dataset save(MobiusJob job, org.apache.hadoop.fs.Path output, java.lang.Class<? extends org.apache.hadoop.mapred.FileOutputFormat> outputFormat, TupleCriterion criteria, Projectable... projections) throws java.io.IOException
projections
into a the specified output
path in the
format of the given outputFormat
.
Only the rows that meet the criteria
will be
stored. The criteria
can only evaluate the
columns specified in the projections
.
output
will be deleted before the job gets started.
java.io.IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |