Public Properties

CompletedRequestHistory The CompletedRequestHistory used to check if a request was processed in a previous run.
Events The WebCrawlerEvents which will fire relevant events during processing.
LinkExtractor The LinkExtractor to use to extract links from web responses.
RequestPriorityComparer The comparer to use determine the order in which requests are processed.
Selector The LinkSelector used to select which links to follow while processing.
SleepTimeInMilliseconds The number of milliseconds to sleep during those actions that require intermitent sleeping.
StartingUris The collection of Uris with which to begin processing.
StorageFactory The factory to use to get a TemporaryStorage for storing the responses of requests.
Store The RequestStore used to store requests.
TimeoutInMilliseconds The number of milliseconds to wait without getting a response form the request's server before a request times out.
WorkerCount The number of workers to use for processing requests.

See Also

WebCrawlerContext Interface | Eas.WebCrawler.Interfaces Namespace