CrawlerNET is a simple web crawler build in C# with dotnet framework.You can easily use for extracting the links you need from any website
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.vs/config
ConsoleCrawler
CrawlerNet
.gitattributes
.gitignore
CrawlerNet.sln
LICENSE
README.md

README.md

[Build status] (https://ci.appveyor.com/project/yemrekeskin/crawlernet/branch/master) Join the chat at https://gitter.im/MvcGeekSamples

CrawlerNet

CrawlerNet is a simple web crawler build in C# with dotnet framework.You can easily use for extracting the links you need from any website

Features

  • Extract Links
  • Filtering to Audio,Data,Document,Video,Web and executable files
  • Configuration Setting
  • Export via JSON,TEXT,EXCEL file

Dependencies

License

The content of this project itself is licensed under the Creative Commons Attribution 3.0 license, and the underlying source code used to format and display that content is licensed under the MIT license.