org.apache.nutch.crawl

Class CrawlDbReducer

java.lang.Object

org.apache.nutch.crawl.CrawlDbReducer

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, JobConfigurable, Reducer<Text,CrawlDatum,Text,CrawlDatum>

public class CrawlDbReducer
extends java.lang.Object
implements Reducer<Text,CrawlDatum,Text,CrawlDatum>

Merge new page entries with existing entries.

Constructor Summary

Constructors

Constructor and Description
CrawlDbReducer()

Method Summary

Modifier and Type	Method and Description
void	close()
void	configure(JobConf job)
void	reduce(Text key, java.util.Iterator<CrawlDatum> values, OutputCollector<Text,CrawlDatum> output, Reporter reporter)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CrawlDbReducer

public CrawlDbReducer()

Method Detail

configure

public void configure(JobConf job)

Specified by:

configure in interface JobConfigurable

close

public void close()

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

reduce

public void reduce(Text key,
                   java.util.Iterator<CrawlDatum> values,
                   OutputCollector<Text,CrawlDatum> output,
                   Reporter reporter)
            throws java.io.IOException

Specified by:

reduce in interface Reducer<Text,CrawlDatum,Text,CrawlDatum>

Throws:

java.io.IOException