Example usage for org.apache.hadoop.util.bloom DynamicBloomFilter and

List of usage examples for org.apache.hadoop.util.bloom DynamicBloomFilter and

Introduction

In this page you can find the example usage for org.apache.hadoop.util.bloom DynamicBloomFilter and.

Prototype

@Override
    public void and(Filter filter) 

Source Link

Usage

From source file:hivemall.sketch.bloom.BloomAndUDFTest.java

License:Apache License

@Test
public void test() throws IOException, HiveException {
    BloomAndUDF udf = new BloomAndUDF();

    DynamicBloomFilter bf1 = createBloomFilter(1L, 10000);
    DynamicBloomFilter bf2 = createBloomFilter(2L, 10000);

    Text bf1str = BloomFilterUtils.serialize(bf1, new Text());
    Text bf2str = BloomFilterUtils.serialize(bf2, new Text());

    bf1.and(bf2);
    Text expected = BloomFilterUtils.serialize(bf1, new Text());

    Text actual = udf.evaluate(bf1str, bf2str);

    Assert.assertEquals(expected, actual);

    DynamicBloomFilter deserialized = BloomFilterUtils.deserialize(actual, new DynamicBloomFilter());
    assertNotContains(bf1, deserialized, 1L, 10000);
    assertNotContains(bf1, deserialized, 2L, 10000);
}