public static class WARCExporter.WARCReducer extends java.lang.Object implements Mapper<Text,Writable,Text,NutchWritable>, Reducer<Text,NutchWritable,NullWritable,com.martinkl.warc.WARCWritable>
| Constructor and Description |
|---|
WARCReducer() |
| Modifier and Type | Method and Description |
|---|---|
void |
close() |
void |
configure(JobConf job) |
void |
map(Text key,
Writable value,
OutputCollector<Text,NutchWritable> output,
Reporter reporter) |
void |
reduce(Text key,
java.util.Iterator<NutchWritable> values,
OutputCollector<NullWritable,com.martinkl.warc.WARCWritable> output,
Reporter reporter) |
public void configure(JobConf job)
configure in interface JobConfigurablepublic void close()
throws java.io.IOException
close in interface java.io.Closeableclose in interface java.lang.AutoCloseablejava.io.IOExceptionpublic void map(Text key, Writable value, OutputCollector<Text,NutchWritable> output, Reporter reporter) throws java.io.IOException
public void reduce(Text key, java.util.Iterator<NutchWritable> values, OutputCollector<NullWritable,com.martinkl.warc.WARCWritable> output, Reporter reporter) throws java.io.IOException
reduce in interface Reducer<Text,NutchWritable,NullWritable,com.martinkl.warc.WARCWritable>java.io.IOExceptionCopyright © 2017 The Apache Software Foundation