Distributed crawler, support a master and many slaves (using redis to save URL, please install your own redis, otherwise you can not run the crawler)

DistributedCrawler-master
DistributedCrawler-master\.DS_Store
__MACOSX
__MACOSX\DistributedCrawler-master
__MACOSX\DistributedCrawler-master\._.DS_Store
DistributedCrawler-master\.gitignore
__MACOSX\DistributedCrawler-master\._.gitignore
DistributedCrawler-master\CrawlerMaster
DistributedCrawler-master\CrawlerMaster\.classpath
__MACOSX\DistributedCrawler-master\CrawlerMaster
__MACOSX\DistributedCrawler-master\CrawlerMaster\._.classpath
DistributedCrawler-master\CrawlerMaster\.DS_Store
__MACOSX\DistributedCrawler-master\CrawlerMaster\._.DS_Store
DistributedCrawler-master\CrawlerMaster\.project
__MACOSX\DistributedCrawler-master\CrawlerMaster\._.project
DistributedCrawler-master\CrawlerMaster\.settings
DistributedCrawler-master\CrawlerMaster\.settings\org.eclipse.core.resources.prefs
__MACOSX\DistributedCrawler-master\CrawlerMaster\.settings
__MACOSX\DistributedCrawler-master\CrawlerMaster\.settings\._org.eclipse.core.resources.prefs
DistributedCrawler-master\CrawlerMaster\.settings\org.eclipse.jdt.core.prefs
__MACOSX\DistributedCrawler-master\CrawlerMaster\.settings\._org.eclipse.jdt.core.prefs
__MACOSX\DistributedCrawler-master\CrawlerMaster\._.settings
DistributedCrawler-master\CrawlerMaster\bin
DistributedCrawler-master\CrawlerMaster\bin\ConsistentHash
DistributedCrawler-master\CrawlerMaster\bin\ConsistentHash\ConsistentHash.class
DistributedCrawler-master\CrawlerMaster\bin\ConsistentHash\HashFunction.class
DistributedCrawler-master\CrawlerMaster\bin\ConsistentHash\MD5.class
DistributedCrawler-master\CrawlerMaster\bin\ConsistentHash\ServerNode.class
DistributedCrawler-master\CrawlerMaster\bin\ConsistentHash\Test.class
DistributedCrawler-master\CrawlerMaster\bin\distribute
DistributedCrawler-master\CrawlerMaster\bin\distribute\Handler$OnAsyncTaskListener.class
DistributedCrawler-master\CrawlerMaster\bin\distribute\Handler.class
DistributedCrawler-master\CrawlerMaster\bin\distribute\SocketServer$1.class
DistributedCrawler-master\CrawlerMaster\bin\distribute\SocketServer.class
DistributedCrawler-master\CrawlerMaster\bin\main
DistributedCrawler-master\CrawlerMaster\bin\main\Index$1.class
DistributedCrawler-master\CrawlerMaster\bin\main\Index$2.class
DistributedCrawler-master\CrawlerMaster\bin\main\Index$3.class
DistributedCrawler-master\CrawlerMaster\bin\main\Index$4.class
DistributedCrawler-master\CrawlerMaster\bin\main\Index$5.class
DistributedCrawler-master\CrawlerMaster\bin\main\Index$6.class
DistributedCrawler-master\CrawlerMaster\bin\main\Index$7.class
DistributedCrawler-master\CrawlerMaster\bin\main\Index$8.class
DistributedCrawler-master\CrawlerMaster\bin\main\Index.class
DistributedCrawler-master\CrawlerMaster\bin\main\TestRedis.class
DistributedCrawler-master\CrawlerMaster\bin\model
DistributedCrawler-master\CrawlerMaster\bin\model\Command.class
DistributedCrawler-master\CrawlerMaster\bin\util
DistributedCrawler-master\CrawlerMaster\bin\util\AppUtil.class
DistributedCrawler-master\CrawlerMaster\bin\util\DbUtil.class
DistributedCrawler-master\CrawlerMaster\bin\util\HttpUtil.class
DistributedCrawler-master\CrawlerMaster\bin\util\PageUtil.class
DistributedCrawler-master\CrawlerMaster\bin\util\RedisUtil.class
DistributedCrawler-master\CrawlerMaster\bin\util\UrlParmUtil.class
DistributedCrawler-master\CrawlerMaster\data
DistributedCrawler-master\CrawlerMaster\data\all.txt
__MACOSX\DistributedCrawler-master\CrawlerMaster\data
__MACOSX\DistributedCrawler-master\CrawlerMaster\data\._all.txt
DistributedCrawler-master\CrawlerMaster\data\baidu-hotel.txt
__MACOSX\DistributedCrawler-master\CrawlerMaster\data\._baidu-hotel.txt
DistributedCrawler-master\CrawlerMaster\data\baidu.txt
__MACOSX\DistributedCrawler-master\CrawlerMaster\data\._baidu.txt
DistributedCrawler-master\CrawlerMaster\data\unvisited.txt
__MACOSX\DistributedCrawler-master\CrawlerMaster\data\._unvisited.txt
__MACOSX\DistributedCrawler-master\CrawlerMaster\._data
DistributedCrawler-master\CrawlerMaster\libs
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\commons-beanutils-1.8.3.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\._commons-beanutils-1.8.3.jar
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\gson-2.2.4-javadoc.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\._gson-2.2.4-javadoc.jar
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\gson-2.2.4-sources.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\._gson-2.2.4-sources.jar
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\gson-2.2.4.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\._gson-2.2.4.jar
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\httpclient-4.3.1.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\._httpclient-4.3.1.jar
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\httpcore-4.3.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\._httpcore-4.3.jar
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\LICENSE
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\._LICENSE
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\mysqldriver.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\._mysqldriver.jar
DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\README
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\google-gson-2.2.4\._README
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\._google-gson-2.2.4
DistributedCrawler-master\CrawlerMaster\libs\jedis-2.0.0.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\._jedis-2.0.0.jar
DistributedCrawler-master\CrawlerMaster\libs\json.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\._json.jar
DistributedCrawler-master\CrawlerMaster\libs\json2.4
DistributedCrawler-master\CrawlerMaster\libs\json2.4\commons-collections-3.2.1.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\json2.4
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\json2.4\._commons-collections-3.2.1.jar
DistributedCrawler-master\CrawlerMaster\libs\json2.4\commons-httpclient-3.0.1.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\json2.4\._commons-httpclient-3.0.1.jar
DistributedCrawler-master\CrawlerMaster\libs\json2.4\commons-lang-2.4.jar
__MACOSX\DistributedCrawler-master\CrawlerMaster\libs\json2.4\._commons-lang-2.4.jar

• We are an exchange download platform that only provides communication channels. The downloaded content comes from the internet. Except for download issues, please Google on your own.
• The downloaded content is provided for members to upload. If it unintentionally infringes on your copyright, please contact us.
• Please use Winrar for decompression tools
• If download fail, Try it againg or Feedback to us.
• If downloaded content did not match the introduction, Feedback to us，Confirm and will be refund.
• Before downloading, you can inquire through the uploaded person information

Nothing．