org.apache.nutch.crawl

Class DeduplicationJob.DedupReducer

java.lang.Object

org.apache.nutch.crawl.DeduplicationJob.DedupReducer

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, JobConfigurable, Reducer<BytesWritable,CrawlDatum,Text,CrawlDatum>

Enclosing class:

DeduplicationJob

public static class DeduplicationJob.DedupReducer
extends java.lang.Object
implements Reducer<BytesWritable,CrawlDatum,Text,CrawlDatum>

Constructor Summary

Constructors

Constructor and Description
DedupReducer()

Method Summary

Modifier and Type	Method and Description
void	close()
void	configure(JobConf arg0)
void	reduce(BytesWritable key, java.util.Iterator<CrawlDatum> values, OutputCollector<Text,CrawlDatum> output, Reporter reporter)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DedupReducer

public DedupReducer()

Method Detail

configure

public void configure(JobConf arg0)

Specified by:

configure in interface JobConfigurable

reduce

public void reduce(BytesWritable key,
                   java.util.Iterator<CrawlDatum> values,
                   OutputCollector<Text,CrawlDatum> output,
                   Reporter reporter)
            throws java.io.IOException

Specified by:

reduce in interface Reducer<BytesWritable,CrawlDatum,Text,CrawlDatum>

Throws:

java.io.IOException

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Throws:

java.io.IOException