org.apache.nutch.crawl
Class Injector

java.lang.Object
  extended by org.apache.hadoop.util.ToolBase
      extended by org.apache.nutch.crawl.Injector
All Implemented Interfaces:
Configurable, Tool

public class Injector
extends ToolBase

This class takes a flat file of URLs and adds them to the of pages to be crawled. Useful for bootstrapping the system.


Nested Class Summary
static class Injector.InjectMapper
          Normalize and filter injected urls.
static class Injector.InjectReducer
          Combine multiple new entries for a url.
 
Field Summary
static org.apache.commons.logging.Log LOG
           
 
Fields inherited from class org.apache.hadoop.util.ToolBase
conf
 
Constructor Summary
Injector()
           
Injector(Configuration conf)
           
 
Method Summary
 void inject(Path crawlDb, Path urlDir)
           
static void main(String[] args)
           
 int run(String[] args)
           
 
Methods inherited from class org.apache.hadoop.util.ToolBase
doMain, getConf, setConf
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

LOG

public static final org.apache.commons.logging.Log LOG
Constructor Detail

Injector

public Injector()

Injector

public Injector(Configuration conf)
Method Detail

inject

public void inject(Path crawlDb,
                   Path urlDir)
            throws IOException
Throws:
IOException

main

public static void main(String[] args)
                 throws Exception
Throws:
Exception

run

public int run(String[] args)
        throws Exception
Throws:
Exception


Copyright © 2006 The Apache Software Foundation