org.apache.nutch.fetcher

Class Fetcher.InputFormat

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<K,V>

org.apache.hadoop.mapred.SequenceFileInputFormat<Text,CrawlDatum>

org.apache.nutch.fetcher.Fetcher.InputFormat

All Implemented Interfaces:

InputFormat<Text,CrawlDatum>

Enclosing class:

Fetcher

public static class Fetcher.InputFormat
extends SequenceFileInputFormat<Text,CrawlDatum>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileInputFormat

FileInputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapred.FileInputFormat

INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES

Constructor Summary

Constructors

Constructor and Description
InputFormat()

Method Summary

Modifier and Type	Method and Description
InputSplit[]	getSplits(JobConf job, int nSplits) Don't split inputs, to keep things polite.

Methods inherited from class org.apache.hadoop.mapred.SequenceFileInputFormat

getRecordReader, listStatus

Methods inherited from class org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, isSplitable, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InputFormat

public InputFormat()

Method Detail

getSplits

public InputSplit[] getSplits(JobConf job,
                              int nSplits)
                       throws java.io.IOException

Don't split inputs, to keep things polite.

Specified by:

getSplits in interface InputFormat<Text,CrawlDatum>

Overrides:

getSplits in class FileInputFormat<Text,CrawlDatum>

Throws:

java.io.IOException