Download mightycrawler Free Java Code
Description
A multithreaded web crawler in Java.
Source Files
The download file mightycrawler-master.zip has the following entries.
CHANGES.txt//from www.j a v a 2s .co m
LICENSE
README.md
crawler.properties
pom.xml
src/main/java/no/bekk/bekkopen/mightycrawler/Configuration.java
src/main/java/no/bekk/bekkopen/mightycrawler/Crawler.java
src/main/java/no/bekk/bekkopen/mightycrawler/DownloadManager.java
src/main/java/no/bekk/bekkopen/mightycrawler/DownloadWorker.java
src/main/java/no/bekk/bekkopen/mightycrawler/IncludeExcludeFilter.java
src/main/java/no/bekk/bekkopen/mightycrawler/Parser.java
src/main/java/no/bekk/bekkopen/mightycrawler/Report.java
src/main/java/no/bekk/bekkopen/mightycrawler/Resource.java
src/main/java/no/bekk/bekkopen/mightycrawler/Storage.java
src/main/java/no/bekk/bekkopen/mightycrawler/URLManager.java
src/main/resources/logback.xml
src/test/java/no/bekk/bekkopen/mightycrawler/IncludeExcludeFilterTest.java
Download
Click the following link to download mightycrawler-master.zip.
mightycrawler-master.zip