org.apache.nutch.indexer

Class IndexingFiltersChecker

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.nutch.util.AbstractChecker

org.apache.nutch.indexer.IndexingFiltersChecker

All Implemented Interfaces:

Configurable, Tool

public class IndexingFiltersChecker
extends AbstractChecker

Reads and parses a URL and run the indexers on it. Displays the fields obtained and the first 100 characters of their value Tested with e.g.

    echo "http://www.lemonde.fr" | $NUTCH_HOME/bin/nutch indexchecker -stdin
 

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	doIndex
protected boolean	dumpText
protected boolean	followRedirects
protected java.util.HashMap<java.lang.String,java.lang.String>	metadata
protected URLNormalizers	normalizers

Fields inherited from class org.apache.nutch.util.AbstractChecker

keepClientCnxOpen, stdin, tcpPort, usage

Constructor Summary

Constructors

Constructor and Description
IndexingFiltersChecker()

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args)
protected int	process(java.lang.String url, java.lang.StringBuilder output)
int	run(java.lang.String[] args)

Methods inherited from class org.apache.nutch.util.AbstractChecker

getProtocolOutput, parseArgs, processSingle, processStdin, processTCP, run

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

normalizers

protected URLNormalizers normalizers

dumpText

protected boolean dumpText

followRedirects

protected boolean followRedirects

doIndex

protected boolean doIndex

metadata

protected java.util.HashMap<java.lang.String,java.lang.String> metadata

Constructor Detail

IndexingFiltersChecker

public IndexingFiltersChecker()

Method Detail

run

public int run(java.lang.String[] args)
        throws java.lang.Exception

Throws:

java.lang.Exception

process

protected int process(java.lang.String url,
                      java.lang.StringBuilder output)
               throws java.lang.Exception

Specified by:

process in class AbstractChecker

Throws:

java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception