Spider.NET
Description
Crawls websites and stores content in an MS SQL or Access database. This can then be indexed and queried for a web site search.
Source Files
The download file spidernet.zip has the following entries.
AssemblyInfo.vb//from w ww.j a v a2 s .c o m
BuildProcessTemplates/DefaultTemplate.11.1.xaml
BuildProcessTemplates/DefaultTemplate.xaml
BuildProcessTemplates/LabDefaultTemplate.11.xaml
BuildProcessTemplates/UpgradeTemplate.xaml
CommandSwitches.vb
Crawler.vb
Functions.vb
HTMLParser.vb
Logger.vb
MyDictionary.vb
PDF2TEXT.vb
RegExFunctions.vb
Spider.NET.sln
Spider.NET.suo
Spider.NET.vbproj
Spider.NET.vbproj.user
Spider.vb
SpiderDB.vb
URLFunctions.vb
db/create_db.sql
db/db.content_types.sql
db/db.html_entity.sql
db/db.project.test.sql
readme.txt
Download
Click the following link to download spidernet.zip.
spidernet.zip