Repository navigation
We are out of alpha! Welcome to WebCrawler, An open-source Python-based web crawler that maps website structure and extracts content. This tool can generate both text and Excel outputs of crawled pages along with visual sitemaps.