Download Web Crawling
Description
Web Crawling is a .NET console application which crawls websites and saves info(e.g title, comments,pageviews etc) and links to a mysql server.
Source Files
The download file webcrawling.zip has the following entries.
WebCrawling.Data.Extracting/CSSParser.cs
WebCrawling.Data.Extracting/DB/MySqlConfig.cs
WebCrawling.Data.Extracting/DB/MySqlDBUtil.cs
WebCrawling.Data.Extracting/EnumDescriptionAttribute.cs
WebCrawling.Data.Extracting/Extensions.cs
WebCrawling.Data.Extracting/GoogleService.cs
WebCrawling.Data.Extracting/HttpRequestSyn.cs
WebCrawling.Data.Extracting/Lib/MySql.Data.dll
WebCrawling.Data.Extracting/Output.cs// w w w. ja v a 2 s .co m
WebCrawling.Data.Extracting/PageRank.cs
WebCrawling.Data.Extracting/Properties/AssemblyInfo.cs
WebCrawling.Data.Extracting/RegularExpressionLibrary.cs
WebCrawling.Data.Extracting/Rules.cs
WebCrawling.Data.Extracting/ThreadPool.cs
WebCrawling.Data.Extracting/Utility.cs
WebCrawling.Data.Extracting/WebCrawling.Data.Extracting.csproj
WebCrawling.Data.Extracting/WebCrawling.Data.Extracting.csproj.vspscc
WebCrawling.Data.Extracting/Workflow.cs
WebCrawling.sln
WebCrawling.vssscc
WebCrawling/Config/Rules.xml
WebCrawling/Program.cs
WebCrawling/Properties/AssemblyInfo.cs
WebCrawling/WebCrawling.csproj
WebCrawling/WebCrawling.csproj.vspscc
Download
Click the following link to download webcrawling.zip.
webcrawling.zip