Classes
Class | Description |
---|---|
ProcessingStateEventArgs |
SummaryTrace argument that wraps a ProcessingState. |
ProcessingStateMessageEventArgs |
SummaryWraps a ProcessingState and a System.String message. |
Request | |
UrlCompletedEventArgs |
SummaryAn System.EventArgs that is used when firing events to notify recipients that a Url was processed succesfully. |
UrlFailedEventArgs |
SummaryAn System.EventArgs which is fired if a Url could not be processed. |
Interfaces
Interface | Description |
---|---|
CompletedRequestHistory |
SummaryThe interface used by the WebCrawlerEngine to store a history of previously completed requests, so that they are not visited again. |
LinkExtractor |
SummaryExtracts links from a processed page. |
LinkSelector |
SummaryDetermines what uris (links) should be crawled. |
ProcessingState |
SummaryStores state that is accumulated while processing a request. |
RequestStore |
SummaryStores Requests which are intended to be processed by the crawler. |
TemporaryStorage |
SummaryAbstracts away temporary storage of the contents of a stream so that it can be accessed later. |
TemporaryStorageFactory |
SummaryCreates instances of TemporaryStorage. |
WebCrawlerComponent |
SummaryClasses which implement this interface will be initialized by the WebCrawlerContext into which they are passed. |
WebCrawlerContext |
SummaryContext used by web crawler during processing. |
WebCrawlerEngine |
SummaryThe main web crawler engine. This interface is used to run the web crawler. |
WebCrawlerEvents |
SummaryContains the collection of events fired while crawling. |
WebCrawlerSettings |
SummaryImplementations of this class are used to create impementations of WebCrawlerEngine. |
WebRequestInterface |
SummaryWraps details about a web request. |
WebResponseInterface |
SummaryWraps a System.Net.WebResponse returned from a request to a System.Uri. |
Enumerations
Enumeration | Description |
---|---|
TraceLevel |
SummaryThe level of tracing to use while processing. |
WorkerState |
SummaryThe different states of processing in which a worker can be. |