Example usage for org.apache.hadoop.fs PathFilter interface-usage

Introduction

In this page you can find the example usage for org.apache.hadoop.fs PathFilter interface-usage.

Usage

final class ClustersFilter implements PathFilter {

    public boolean accept(Path path) {
        String pathString = path.toString();
        return pathString.contains("/clusters-");
    }

From source file cn.lhfei.hadoop.ch03.RegexExcludePathFilter.java

/**
 * @version 0.1
 *
 * @author Hefei Li
 *
 * @since Oct 27, 2014

From source file cn.lhfei.hadoop.ch03.RegexPathFilter.java

/**
 * @version 0.1
 *
 * @author Hefei Li
 *
 * @since Oct 27, 2014

From source file co.cask.cdap.template.etl.common.BatchFileFilter.java

/**
 * Filter class to filter out filenames in the input path.
 *
 * The stateful time filter works as follows. A list of times are kept in the table in FileBatchSource. The list always
 * denotes ranges of times where files have not been read in yet. The list is read in prepareRun and then converted to
 * a string and passed in as dateRangesToRead, which is described below. The files are assumed to succeed so that files

From source file co.cask.hydrator.plugin.batch.source.ExcelReaderRegexFilter.java

/**
 * Filter class to filter out Excel filenames in the input path.
 */
public class ExcelReaderRegexFilter extends Configured implements PathFilter {

    public static final String FILE_PATTERN = "filePattern";

From source file co.cask.hydrator.plugin.common.BatchFileFilter.java

/**
 * Filter class to filter out filenames in the input path.
 *
 * The stateful time filter works as follows. A list of times are kept in the table in FileBatchSource. The list always
 * denotes ranges of times where files have not been read in yet. The list is read in prepareRun and then converted to
 * a string and passed in as dateRangesToRead, which is described below. The files are assumed to succeed so that files

From source file co.cask.hydrator.plugin.common.BatchXMLFileFilter.java

/**
 * Filter class to filter out XML filenames in the input path.
 */
public class BatchXMLFileFilter extends Configured implements PathFilter {
    private static final Gson GSON = new Gson();
    private static final Type ARRAYLIST_PREPROCESSED_FILES = new TypeToken<ArrayList<String>>() {

From source file com.cloudera.hoop.fs.FSListStatus.java

/**
 * Executor that performs a list-status Hadoop files system operation.
 */
public class FSListStatus implements Hadoop.FileSystemExecutor<JSONArray>, PathFilter {
    private Path path;
    private PathFilter filter;

From source file com.cloudera.oryx.common.servcomp.FilesOrDirsPathFilter.java

final class FilesOrDirsPathFilter implements PathFilter {

    private final FileSystem fs;
    private final boolean files;

    FilesOrDirsPathFilter(FileSystem fs, boolean files) {

From source file com.ibm.stocator.fs.common.ObjectStoreGlobFilter.java

/**
 * A filter for POSIX glob pattern with brace expansions.
 */
public class ObjectStoreGlobFilter implements PathFilter {
    private static final PathFilter DEFAULT_FILTER = new PathFilter() {
        @Override