NwebCrawler is a multi-threaded web crawler program written in C#, it is the realization of the principle of the first to enter one or more seed URL to the queue, and then extracted from the queue URL (FIFO principle), analysis of this page to find the appropriate label and get the href attribute value, useful links page crawling and deposited in the web library, with crawling history to record climbed pages, so to avoid a repeat of crawling. Extract URL stored in the queue, and the next one crawling. NwebCrawler search strategy is breadth-first search. Breadth-first strategy is conducive to multiple threads parallel crawling and crawling closed strong.

源代码
......\CrawlerThread.cs
......\CrawlHistroyEntry.cs
......\Downloader.cs
......\EventStream.cs
......\MemCache.cs
......\NWebCrawlerLib.csproj
......\Parser.cs
......\Program.cs
......\Settings.cs
......\UrlQueueManager.cs
......\Utility.cs

• We are an exchange download platform that only provides communication channels. The downloaded content comes from the internet. Except for download issues, please Google on your own.
• The downloaded content is provided for members to upload. If it unintentionally infringes on your copyright, please contact us.
• Please use Winrar for decompression tools
• If download fail, Try it againg or Feedback to us.
• If downloaded content did not match the introduction, Feedback to us，Confirm and will be refund.
• Before downloading, you can inquire through the uploaded person information

Nothing．