|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.nutch.crawl.Generator.Selector
public static class Generator.Selector
Selects entries due for fetch.
Constructor Summary | |
---|---|
Generator.Selector()
|
Method Summary | |
---|---|
void |
close()
|
void |
configure(JobConf job)
|
int |
getPartition(WritableComparable key,
Writable value,
int numReduceTasks)
Partition by host. |
void |
map(WritableComparable key,
Writable value,
OutputCollector output,
Reporter reporter)
Select & invert subset due for fetch. |
void |
reduce(WritableComparable key,
Iterator values,
OutputCollector output,
Reporter reporter)
Collect until limit is reached. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public Generator.Selector()
Method Detail |
---|
public void configure(JobConf job)
configure
in interface JobConfigurable
public void close()
close
in interface Closeable
public void map(WritableComparable key, Writable value, OutputCollector output, Reporter reporter) throws IOException
map
in interface Mapper
IOException
public int getPartition(WritableComparable key, Writable value, int numReduceTasks)
getPartition
in interface Partitioner
public void reduce(WritableComparable key, Iterator values, OutputCollector output, Reporter reporter) throws IOException
reduce
in interface Reducer
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |