Package org.apache.nutch.crawl

Class DeduplicationJob.DBFilter

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<Text,CrawlDatum,BytesWritable,CrawlDatum>

org.apache.nutch.crawl.DeduplicationJob.DBFilter

Enclosing class:

DeduplicationJob

public static class DeduplicationJob.DBFilter
extends Mapper<Text,CrawlDatum,BytesWritable,CrawlDatum>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

Mapper.Context

Constructor Summary

Constructors

Constructor	Description
DBFilter()

Method Summary

Modifier and Type	Method	Description
void	map(Text key, CrawlDatum value, Mapper<Text,CrawlDatum,BytesWritable,CrawlDatum>.Context context)
void	setup(Mapper<Text,CrawlDatum,BytesWritable,CrawlDatum>.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DBFilter

public DBFilter()

Method Details

setup

public void setup(Mapper<Text,CrawlDatum,BytesWritable,CrawlDatum>.Context context)

Overrides:

setup in class Mapper<Text,CrawlDatum,BytesWritable,CrawlDatum>

map

public void map(Text key,
 CrawlDatum value,
 Mapper<Text,CrawlDatum,BytesWritable,CrawlDatum>.Context context)
         throws IOException,
InterruptedException

Overrides:

map in class Mapper<Text,CrawlDatum,BytesWritable,CrawlDatum>

Throws:

IOException

InterruptedException