org.apache.nutch.scoring.webgraph

Class WebGraph.OutlinkDb

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.nutch.scoring.webgraph.WebGraph.OutlinkDb

All Implemented Interfaces:

Configurable

Enclosing class:

WebGraph

public static class WebGraph.OutlinkDb
extends Configured

The OutlinkDb creates a database of all outlinks. Outlinks to internal urls by domain and host can be ignored. The number of Outlinks out to a given page or domain can also be limited.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WebGraph.OutlinkDb.OutlinkDbMapper Passes through existing LinkDatum objects from an existing OutlinkDb and maps out new LinkDatum objects from new crawls ParseData.
static class	WebGraph.OutlinkDb.OutlinkDbReducer

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	URL_FILTERING
static java.lang.String	URL_NORMALIZING

Constructor Summary

Constructors

Constructor and Description
OutlinkDb() Default constructor.
OutlinkDb(Configuration conf) Configurable constructor.

Method Summary

Modifier and Type	Method and Description
void	close()

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

URL_NORMALIZING

public static final java.lang.String URL_NORMALIZING

See Also:

Constant Field Values

URL_FILTERING

public static final java.lang.String URL_FILTERING

See Also:

Constant Field Values

Constructor Detail

OutlinkDb

public OutlinkDb()

Default constructor.

OutlinkDb

public OutlinkDb(Configuration conf)

Configurable constructor.

Method Detail

close

public void close()