org.apache.nutch.crawl

Class CrawlDbReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<Text,CrawlDatum,Text,CrawlDatum>

org.apache.nutch.crawl.CrawlDbReducer

public class CrawlDbReducer
extends Reducer<Text,CrawlDatum,Text,CrawlDatum>

Merge new page entries with existing entries.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

Reducer.Context

Constructor Summary

Constructors

Constructor and Description
CrawlDbReducer()

Method Summary

Modifier and Type	Method and Description
void	close()
void	reduce(Text key, java.lang.Iterable<CrawlDatum> values, Reducer.Context context)
void	setup(Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CrawlDbReducer

public CrawlDbReducer()

Method Detail

setup

public void setup(Reducer.Context context)

Overrides:

setup in class Reducer<Text,CrawlDatum,Text,CrawlDatum>

close

public void close()

reduce

public void reduce(Text key,
                   java.lang.Iterable<CrawlDatum> values,
                   Reducer.Context context)
            throws java.io.IOException,
                   java.lang.InterruptedException

Overrides:

reduce in class Reducer<Text,CrawlDatum,Text,CrawlDatum>

Throws:

java.io.IOException

java.lang.InterruptedException