ASP.NET Core 3.0 SignalR Web based crawler for site broken links based on https://github.com/hmol/LinkCrawler
-
Updated
Jul 17, 2019 - C#
ASP.NET Core 3.0 SignalR Web based crawler for site broken links based on https://github.com/hmol/LinkCrawler
Parse robots.txt and traverse sitemaps.
Simple CLI tool, written in C#, to crawl a site and log the responses.
Add a description, image, and links to the crawl topic page so that developers can more easily learn about it.
To associate your repository with the crawl topic, visit your repo's landing page and select "manage topics."