org.apache.nutch.fetcher

Class FetcherOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<Text,NutchWritable>

org.apache.nutch.fetcher.FetcherOutputFormat

public class FetcherOutputFormat
extends FileOutputFormat<Text,NutchWritable>

Splits FetcherOutput entries into multiple map files.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

FileOutputFormat.Counter

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

BASE_OUTPUT_NAME, COMPRESS, COMPRESS_CODEC, COMPRESS_TYPE, OUTDIR, PART

Constructor Summary

Constructors

Constructor and Description
FetcherOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(JobContext job)
RecordWriter<Text,NutchWritable>	getRecordWriter(TaskAttemptContext context)

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FetcherOutputFormat

public FetcherOutputFormat()

Method Detail

checkOutputSpecs

public void checkOutputSpecs(JobContext job)
                      throws java.io.IOException

Overrides:

checkOutputSpecs in class FileOutputFormat<Text,NutchWritable>

Throws:

java.io.IOException

getRecordWriter

public RecordWriter<Text,NutchWritable> getRecordWriter(TaskAttemptContext context)
                                                 throws java.io.IOException

Specified by:

getRecordWriter in class FileOutputFormat<Text,NutchWritable>

Throws:

java.io.IOException