org.apache.nutch.fetcher

Class FetcherOutputFormat

java.lang.Object

org.apache.nutch.fetcher.FetcherOutputFormat

All Implemented Interfaces:

OutputFormat<Text,NutchWritable>

public class FetcherOutputFormat
extends java.lang.Object
implements OutputFormat<Text,NutchWritable>

Splits FetcherOutput entries into multiple map files.

Constructor Summary

Constructors

Constructor and Description
FetcherOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(FileSystem fs, JobConf job)
RecordWriter<Text,NutchWritable>	getRecordWriter(FileSystem fs, JobConf job, java.lang.String name, Progressable progress)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FetcherOutputFormat

public FetcherOutputFormat()

Method Detail

checkOutputSpecs

public void checkOutputSpecs(FileSystem fs,
                             JobConf job)
                      throws java.io.IOException

Specified by:

checkOutputSpecs in interface OutputFormat<Text,NutchWritable>

Throws:

java.io.IOException

getRecordWriter

public RecordWriter<Text,NutchWritable> getRecordWriter(FileSystem fs,
                                                        JobConf job,
                                                        java.lang.String name,
                                                        Progressable progress)
                                                 throws java.io.IOException

Specified by:

getRecordWriter in interface OutputFormat<Text,NutchWritable>

Throws:

java.io.IOException