|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
item
, with the supplied
priority
.
Configuration
.
String
can be decoded in reverse and the
first character is represented by a terminal node.
String
can be decoded and the last character is
represented by a terminal node.
NutchAnalyzer
plugins.CircularDependencyException
will be thrown if a circular
dependency is detected.OnlineClusterer
extension using clustering components of the Carrot2 project
(http://carrot2.sourceforge.net).OnlineClusterer
for documentation.
HitDetails
objects) and
their previously extracted summaries (String
s).
true
if item
exists in this
FibonacciHeap
, false otherwise.
Configuration
for Nutch.
RegexRule
.
priority
value associated with
item
.
application/octet-stream
MimeType
Extension
is a kind of listener descriptor that will be
installed on a concrete ExtensionPoint
that acts as kind of
Publisher.ExtensionPoint
provide meta information of a extension
point.HitSummarizer
and HitContent
for a set of
fetched segments.FibonacciHeap
.
CrawlDatum.getScore()
.
analyzer
implementation
given a language code.
Configuration
for Nutch front-end.
List
of RSSChannel
s that the listener parsed from
the RSS document.
Configurable
String
description of the RSS Channel.
i
th field.
i
th hit in this list.
robotsMeta
to appropriate
values, based on any META tags found under the given
node
.
node
, and creates appropriate Outlink
records for each (relative to the supplied base
URL), and adds them to the outlinks
ArrayList
.
Outlink
from given plain text.
Outlink
from given plain text and adds anchor
to the extracted Outlink
s
Microsoft document
extractor
.
ParseImpl
.
Parser
instance with the specified
extId
, representing its extension ID.
Parser
s for a given content type.
Plugin
class.
null
.
Properties
of the Microsoft document.
Protocol
implementation for a url.
Content
for a fetchlist entry.
Summarizer
extension.
StringBuffer
and a DOM Node
,
and will append all the content text found beneath the DOM node to
the StringBuffer
.
getText(sb, node, false)
.
StringBuffer
and a DOM Node
,
and will append the content text found beneath the first
title
node to the StringBuffer
.
i
th field.
RawCluster
interface to
HitsCluster
interface.HtmlParseFilter
implementing plugins.IndexingFilter
implementing plugins.Searcher
and HitDetailer
for either a single
merged index, or a set of indexes.Inlink
s.false
if the robots.txt
file
prohibits us from accessing the given url
, or
true
otherwise.
false
if the robots.txt
file
prohibits us from accessing the given path
, or
true
otherwise.
false
if the robots.txt
file
prohibits us from accessing the given url
, or
true
otherwise.
true
if this cluster constains documents
that did not fit anywhere else (presentation layer may
discard such clusters).
IndexingFilter
that
add a lang
(language) field to the document.s
padded with leading spaces so
that it's length is length
.
input that is matched,
or null if no match exists.
- longestMatch(String) -
Method in class org.apache.nutch.util.SuffixStringMatcher
- Returns the longest suffix of
input that is matched,
or null if no match exists.
- longestMatch(String) -
Method in class org.apache.nutch.util.TrieStringMatcher
- Returns the longest substring of
input that is
matched by a pattern in the trie, or null if no match
exists.
- lookingAhead -
Variable in class org.apache.nutch.analysis.NutchAnalysis
-
- LuceneSummarizer - Class in org.apache.nutch.summary.lucene
- Implements hit summarization.
- LuceneSummarizer() -
Constructor for class org.apache.nutch.summary.lucene.LuceneSummarizer
-
java.util.HashMap
.TrieStringMatcher.TrieNode
visited, given that you are at
node
, and the the next character in the input is
the idx
'th character of s
.
String
is matched by a
prefix in the trie
String
is matched by a
suffix in the trie
String
is matched by a
pattern in the trie
application/vnd.ms-excel
).
application/vnd.ms-powerpoint
).
application/msword
).
MissingDependencyException
will be thrown if a plugin
dependency cannot be found.Configuration
s that include Nutch-specific
resources.RawDocument
required for Carrot2.summary
and wrapping
a details
hit details.
JobConf
for Nutch jobs.OnlineClusterer
extensions.Ontology
extensions.Plugin
System.http
,
httpclient
)Outlink
s
/ URLs from plain text using Regular Expressions.Parser
s
until a successful parse is performed and a Parse
object is
returned.
Content
object using the Parser
specified
by the parameter extId
, i.e., the Parser's extension ID.
Protocol
implementation.Parser
plugins.Parser
s to obtain
Parse
objects.Content
metadata.
FibonacciHeap.popMin()
would, without
removing it.
PluginClassLoader
contains only classes of the runtime
libraries setuped in the plugin manifest file and exported libraries of
plugins that are required pluguin.PluginDescriptor
provide access to all meta information of
a nutch-plugin, as well to the internationalizable resources and the plugin
own classloader.PluginManifestParser
parser just parse the manifest file
in all plugin directories.PluginRuntimeException
will be thrown until a exception in the
plugin managemnt occurs.String
s against a set
of prefixes.PrefixStringMatcher
which will match
String
s with any prefix in the supplied array.
PrefixStringMatcher
which will match
String
s with any prefix in the supplied
Collection
.
ProtocolException
instead.Protocol
plugins.QueryFilter
implementing plugins.Java Regex implementation
.URL filter
based on
regular expressions.IndexingFilter
that
add tag
field(s) to the document."tag:" query clauses.- RelTagQueryFilter() -
Constructor for class org.apache.nutch.microformats.reltag.RelTagQueryFilter
-
- remove(Writable) -
Method in class org.apache.nutch.crawl.MapWritable
-
- remove(String) -
Method in class org.apache.nutch.metadata.Metadata
- Remove a metadata and all its associated values.
- remove(String) -
Method in class org.apache.nutch.metadata.SpellCheckedMetadata
-
- removeLockFile(FileSystem, Path) -
Static method in class org.apache.nutch.util.LockUtil
- Remove lock file.
- renameFile(String, String) -
Method in class org.apache.nutch.indexer.FsDirectory
-
- renderAnonymous(PrintStream, Resource, String) -
Static method in class org.apache.nutch.ontology.jena.OntologyImpl
-
- renderClassDescription(PrintStream, OntClass, int) -
Static method in class org.apache.nutch.ontology.jena.OntologyImpl
-
- renderHierarchy(PrintStream, OntClass, List, int) -
Static method in class org.apache.nutch.ontology.jena.OntologyImpl
-
- renderRestriction(PrintStream, Restriction) -
Static method in class org.apache.nutch.ontology.jena.OntologyImpl
-
- renderURI(PrintStream, PrefixMapping, String) -
Static method in class org.apache.nutch.ontology.jena.OntologyImpl
-
- reset() -
Method in class org.apache.nutch.parse.HTMLMetaTags
- Sets all boolean values to
false
.
- resolveEncodingAlias(String) -
Static method in class org.apache.nutch.util.StringUtil
-
- Response - Interface in org.apache.nutch.net.protocols
- A response inteface.
- retrieve(String) -
Static method in class org.apache.nutch.ontology.jena.OntologyImpl
-
- retrieveFile(String, OutputStream, int) -
Method in class org.apache.nutch.protocol.ftp.Client
-
- retrieveList(String, List, int, FTPFileEntryParser) -
Method in class org.apache.nutch.protocol.ftp.Client
-
- RETRY -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
- Temporary failure.
- REVISION_NUMBER -
Static variable in interface org.apache.nutch.metadata.Office
-
- rightPad(String, int) -
Static method in class org.apache.nutch.util.StringUtil
- Returns a copy of
s
padded with trailing spaces so
that it's length is length
.
- RIGHTS -
Static variable in interface org.apache.nutch.metadata.DublinCore
- Information about rights held in and over the resource.
- RobotRules - Interface in org.apache.nutch.protocol
- This class holds the rules which were parsed from a robots.txt file, and can
test paths against those rules.
- RobotRulesParser - Class in org.apache.nutch.protocol.http.api
- This class handles the parsing of
robots.txt
files. - RobotRulesParser(Configuration) -
Constructor for class org.apache.nutch.protocol.http.api.RobotRulesParser
-
- RobotRulesParser.RobotRuleSet - Class in org.apache.nutch.protocol.http.api
- This class holds the rules which were parsed from a robots.txt
file, and can test paths against those rules.
- RobotRulesParser.RobotRuleSet() -
Constructor for class org.apache.nutch.protocol.http.api.RobotRulesParser.RobotRuleSet
-
- ROBOTS_DENIED -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
- Access denied by robots.txt rules.
- root -
Variable in class org.apache.nutch.util.TrieStringMatcher
-
- rootClasses(OntModel) -
Method in class org.apache.nutch.ontology.jena.OwlParser
-
- rootClasses(OntModel) -
Method in interface org.apache.nutch.ontology.jena.Parser
-
- RSSChannel - Class in org.apache.nutch.parse.rss.structs
-
Data class for holding RSS Channels to send to Nutch's indexer
- RSSChannel(String, String, String, List) -
Constructor for class org.apache.nutch.parse.rss.structs.RSSChannel
-
Default Constructor
- RSSChannel(String, String, String) -
Constructor for class org.apache.nutch.parse.rss.structs.RSSChannel
-
Constructor if you don't have the list of RSS Items ready yet.
- RSSItem - Class in org.apache.nutch.parse.rss.structs
-
Data class for holding RSS Items to send to Nutch's indexer
- RSSItem(String, String, String, String) -
Constructor for class org.apache.nutch.parse.rss.structs.RSSItem
-
- RSSParser - Class in org.apache.nutch.parse.rss
-
- RSSParser() -
Constructor for class org.apache.nutch.parse.rss.RSSParser
-
- RULES -
Static variable in class org.apache.nutch.protocol.EmptyRobotRules
-
- run(String[]) -
Method in class org.apache.nutch.crawl.CrawlDb
-
- run(String[]) -
Method in class org.apache.nutch.crawl.CrawlDbMerger
-
- run(String[]) -
Method in class org.apache.nutch.crawl.Generator
-
- run(String[]) -
Method in class org.apache.nutch.crawl.Injector
-
- run(String[]) -
Method in class org.apache.nutch.crawl.LinkDb
-
- run(String[]) -
Method in class org.apache.nutch.crawl.LinkDbMerger
-
- run(String[]) -
Method in class org.apache.nutch.crawl.LinkDbReader
-
- run(RecordReader, OutputCollector, Reporter) -
Method in class org.apache.nutch.fetcher.Fetcher
-
- run(String[]) -
Method in class org.apache.nutch.fetcher.Fetcher
-
- run(RecordReader, OutputCollector, Reporter) -
Method in class org.apache.nutch.fetcher.Fetcher2
-
- run(String[]) -
Method in class org.apache.nutch.indexer.DeleteDuplicates
-
- run(String[]) -
Method in class org.apache.nutch.indexer.Indexer
-
- run(String[]) -
Method in class org.apache.nutch.indexer.IndexMerger
-
- run(String[]) -
Method in class org.apache.nutch.indexer.IndexSorter
-
- run() -
Method in class org.apache.nutch.searcher.DistributedSearch.Client
-
- run(String[]) -
Method in class org.apache.nutch.tools.compat.CrawlDbConverter
-
- run(String[]) -
Method in class org.apache.nutch.tools.FreeGenerator
-
- run() -
Method in class org.apache.nutch.tools.PruneIndexTool
- For each query, find all matching documents and delete them from all input
indexes.
Fetcher
when processing
redirect URLs.
Generator
.
Injector
.
Outlink
instances.
PartitionUrlByHost
.
ScoringFilter
implementing plugins.MetaWrapper
, to permit merging different
types in reduce and use additional metadata.baseHref
.
Configurable
noCache
to true
.
noFollow
to true
.
noIndex
to true
.
refresh
to the supplied value.
refreshHref
.
refreshTime
.
Hits.totalIsExact()
.
input that is matched,
or null if no match exists.
- shortestMatch(String) -
Method in class org.apache.nutch.util.SuffixStringMatcher
- Returns the shortest suffix of
input that is matched,
or null if no match exists.
- shortestMatch(String) -
Method in class org.apache.nutch.util.TrieStringMatcher
- Returns the shortest substring of
input that is
matched by a pattern in the trie, or null if no match
exists.
- shutDown() -
Method in class org.apache.nutch.plugin.Plugin
- Shutdown the plugin.
- shutdown() -
Method in class org.apache.nutch.util.ThreadPool
- Turn off the pool.
- Signature - Class in org.apache.nutch.crawl
-
- Signature() -
Constructor for class org.apache.nutch.crawl.Signature
-
- SIGNATURE_KEY -
Static variable in interface org.apache.nutch.metadata.Nutch
-
- SignatureComparator - Class in org.apache.nutch.crawl
-
- SignatureComparator() -
Constructor for class org.apache.nutch.crawl.SignatureComparator
-
- SignatureFactory - Class in org.apache.nutch.crawl
- Factory class, which instantiates a Signature implementation according to the
current Configuration configuration.
- SIGRAM -
Static variable in interface org.apache.nutch.analysis.NutchAnalysisConstants
-
- SiteQueryFilter - Class in org.apache.nutch.searcher.site
- Handles "site:" query clauses, causing them to search the field indexed by
SiteIndexingFilter.
- SiteQueryFilter() -
Constructor for class org.apache.nutch.searcher.site.SiteQueryFilter
-
- size() -
Method in class org.apache.nutch.crawl.Inlinks
-
- size() -
Method in class org.apache.nutch.crawl.MapWritable
-
- size() -
Method in class org.apache.nutch.metadata.Metadata
- Returns the number of metadata names in this metadata.
- size() -
Method in class org.apache.nutch.util.FibonacciHeap
- Returns the number of objects in the heap.
- skip(DataInput) -
Static method in class org.apache.nutch.crawl.Inlink
- Skips over one Inlink in the input.
- skip(DataInput) -
Static method in class org.apache.nutch.parse.Outlink
- Skips over one Outlink in the input.
- skippedEntity(String) -
Method in class org.apache.nutch.parse.html.DOMBuilder
- Receive notification of a skipped entity.
- SLASH -
Static variable in interface org.apache.nutch.analysis.NutchAnalysisConstants
-
- sort(File) -
Method in class org.apache.nutch.indexer.IndexSorter
-
- SOURCE -
Static variable in interface org.apache.nutch.metadata.DublinCore
- A reference to a resource from which the present resource is derived.
- SpellCheckedMetadata - Class in org.apache.nutch.metadata
- A decorator to Metadata that adds spellchecking capabilities to property
names.
- SpellCheckedMetadata() -
Constructor for class org.apache.nutch.metadata.SpellCheckedMetadata
-
- start -
Variable in class org.apache.nutch.segment.SegmentReader.SegmentReaderStats
-
- startCDATA() -
Method in class org.apache.nutch.parse.html.DOMBuilder
- Report the start of a CDATA section.
- startDocument() -
Method in class org.apache.nutch.parse.html.DOMBuilder
- Receive notification of the beginning of a document.
- startDTD(String, String, String) -
Method in class org.apache.nutch.parse.html.DOMBuilder
- Report the start of DTD declarations, if any.
- startElement(String, String, String, Attributes) -
Method in class org.apache.nutch.parse.html.DOMBuilder
- Receive notification of the beginning of an element.
- startEntity(String) -
Method in class org.apache.nutch.parse.html.DOMBuilder
- Report the beginning of an entity.
- startPrefixMapping(String, String) -
Method in class org.apache.nutch.parse.html.DOMBuilder
- Begin the scope of a prefix-URI Namespace mapping.
- startProcessing(RequestContext) -
Method in class org.apache.nutch.clustering.carrot2.LocalNutchInputComponent
- A callback hook that starts the processing.
- startUp() -
Method in class org.apache.nutch.plugin.Plugin
- Will be invoked until plugin start up.
- statNames -
Static variable in class org.apache.nutch.crawl.CrawlDatum
-
- STATUS_BLOCKED -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_DB_FETCHED -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Page was successfully fetched.
- STATUS_DB_GONE -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Page no longer exists.
- STATUS_DB_MAX -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Maximum value of DB-related status.
- STATUS_DB_REDIR_PERM -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Page permanently redirects to other page.
- STATUS_DB_REDIR_TEMP -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Page temporarily redirects to other page.
- STATUS_DB_UNFETCHED -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Page was not fetched yet.
- STATUS_FAILED -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_FAILURE -
Static variable in class org.apache.nutch.parse.ParseStatus
-
- STATUS_FETCH_GONE -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Fetching unsuccessful - page is gone.
- STATUS_FETCH_MAX -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Maximum value of fetch-related status.
- STATUS_FETCH_REDIR_PERM -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Fetching permanently redirected to other page.
- STATUS_FETCH_REDIR_TEMP -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Fetching temporarily redirected to other page.
- STATUS_FETCH_RETRY -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Fetching unsuccessful, needs to be retried (transient errors).
- STATUS_FETCH_SUCCESS -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Fetching was successful.
- STATUS_GONE -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_INJECTED -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Page was newly injected.
- STATUS_LINKED -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Page discovered through a link.
- STATUS_NOTFETCHING -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_NOTFOUND -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_NOTMODIFIED -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_NOTPARSED -
Static variable in class org.apache.nutch.parse.ParseStatus
-
- STATUS_REDIR_EXCEEDED -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_RETRY -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_ROBOTS_DENIED -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_SIGNATURE -
Static variable in class org.apache.nutch.crawl.CrawlDatum
- Page signature.
- STATUS_SUCCESS -
Static variable in class org.apache.nutch.parse.ParseStatus
-
- STATUS_SUCCESS -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- STATUS_WOULDBLOCK -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
-
- StringUtil - Class in org.apache.nutch.util
- A collection of String processing utility methods.
- StringUtil() -
Constructor for class org.apache.nutch.util.StringUtil
-
- subclasses(String) -
Method in class org.apache.nutch.ontology.jena.OntologyImpl
- retrieve all subclasses of entity(ies) hashed to searchTerm
- subclasses(String) -
Method in interface org.apache.nutch.ontology.Ontology
-
- SUBJECT -
Static variable in interface org.apache.nutch.metadata.DublinCore
- The topic of the content of the resource.
- SUCCESS -
Static variable in class org.apache.nutch.parse.ParseStatus
- Parsing succeeded.
- SUCCESS -
Static variable in class org.apache.nutch.protocol.ProtocolStatus
- Content was retrieved without errors.
- SUCCESS_REDIRECT -
Static variable in class org.apache.nutch.parse.ParseStatus
- Parsed content contains a directive to redirect to another URL.
- SuffixStringMatcher - Class in org.apache.nutch.util
- A class for efficiently matching
String
s against a set
of suffixes. - SuffixStringMatcher(String[]) -
Constructor for class org.apache.nutch.util.SuffixStringMatcher
- Creates a new
PrefixStringMatcher
which will match
String
s with any suffix in the supplied array.
- SuffixStringMatcher(Collection) -
Constructor for class org.apache.nutch.util.SuffixStringMatcher
- Creates a new
PrefixStringMatcher
which will match
String
s with any suffix in the supplied
Collection
- Summarizer - Interface in org.apache.nutch.searcher
- Extension point for summarizer.
- SummarizerFactory - Class in org.apache.nutch.searcher
- A factory for retrieving
Summarizer
extensions. - SummarizerFactory(Configuration) -
Constructor for class org.apache.nutch.searcher.SummarizerFactory
-
- Summary - Class in org.apache.nutch.searcher
- A document summary dynamically generated to match a query.
- Summary() -
Constructor for class org.apache.nutch.searcher.Summary
- Constructs an empty Summary.
- Summary.Ellipsis - Class in org.apache.nutch.searcher
- An ellipsis fragment within a summary.
- Summary.Ellipsis() -
Constructor for class org.apache.nutch.searcher.Summary.Ellipsis
- Constructs an ellipsis fragment for the given text.
- Summary.Fragment - Class in org.apache.nutch.searcher
- A fragment of text within a summary.
- Summary.Fragment(String) -
Constructor for class org.apache.nutch.searcher.Summary.Fragment
- Constructs a fragment for the given text.
- Summary.Highlight - Class in org.apache.nutch.searcher
- A highlighted fragment of text within a summary.
- Summary.Highlight(String) -
Constructor for class org.apache.nutch.searcher.Summary.Highlight
- Constructs a highlighted fragment for the given text.
- SWFParser - Class in org.apache.nutch.parse.swf
- Parser for Flash SWF files.
- SWFParser() -
Constructor for class org.apache.nutch.parse.swf.SWFParser
-
- SwitchTo(int) -
Method in class org.apache.nutch.analysis.NutchAnalysisTokenManager
-
- synonyms(String) -
Method in class org.apache.nutch.ontology.jena.OntologyImpl
- retrieves synonyms from wordnet via sweet's web interface
- synonyms(String) -
Method in interface org.apache.nutch.ontology.Ontology
-
StringUtil.toHexString(byte[], String, int)
, where
sep = null; lineLen = Integer.MAX_VALUE
.
Hits.getTotal()
gives the exact number of hits, or false if
it is only an estimate of the total number of hits.
sizeLimit
bytes, if necessary.
URLFilter
implementing plugins.
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |