org.apache.nutch.indexer.subcollection

Class SubcollectionIndexingFilter

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.nutch.indexer.subcollection.SubcollectionIndexingFilter

All Implemented Interfaces:

Configurable, IndexingFilter, FieldPluggable, Pluggable

public class SubcollectionIndexingFilter
extends Configured
implements IndexingFilter

Field Summary

Fields

Modifier and Type	Field and Description
static String	FIELD_NAME Doc field name
static org.slf4j.Logger	LOG Logger

Fields inherited from interface org.apache.nutch.indexer.IndexingFilter

X_POINT_ID

Constructor Summary

Constructors

Constructor and Description
SubcollectionIndexingFilter()
SubcollectionIndexingFilter(Configuration conf)

Method Summary

Methods

Modifier and Type	Method and Description
NutchDocument	filter(NutchDocument doc, String url, WebPage page) Adds fields or otherwise modifies the document that will be indexed for a parse.
Collection<WebPage.Field>	getFields()

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

FIELD_NAME

public static final String FIELD_NAME

Doc field name

See Also:

Constant Field Values

LOG

public static final org.slf4j.Logger LOG

Logger

Constructor Detail

SubcollectionIndexingFilter

public SubcollectionIndexingFilter()

SubcollectionIndexingFilter

public SubcollectionIndexingFilter(Configuration conf)

Method Detail

getFields

public Collection<WebPage.Field> getFields()

Specified by:

getFields in interface FieldPluggable

filter

public NutchDocument filter(NutchDocument doc,
                   String url,
                   WebPage page)
                     throws IndexingException

Description copied from interface: IndexingFilter

Adds fields or otherwise modifies the document that will be indexed for a parse. Unwanted documents can be removed from indexing by returning a null value.

Specified by:

filter in interface IndexingFilter

Parameters:

doc - document instance for collecting fields

url - page url

Returns:

modified (or a new) document instance, or null (meaning the document should be discarded)

Throws:

IndexingException