A standalone python program that crawls a website and builds it's Site Map XML file.
-
Updated
Nov 12, 2016 - Python
A standalone python program that crawls a website and builds it's Site Map XML file.
Library that helps generate XML files according to sitemaps.org protocol.
Traverse site and represent it as a graph
Asynchronous website cache warmer
web-crawling using python from website with sitemap and pagination
Generate a sitemap of a website for search engine to crawl the content.
Generate a redirect map from two sitemaps for website migration.
validate on page html hreflang tags and also xml sitemap hreflang annotation
eats a specifically formatted mapping file and spits out a sitemap
A free CSV sitemap generator that does all the work for you.
Simple sitemap generator with Python 3
Add a description, image, and links to the sitemap topic page so that developers can more easily learn about it.
To associate your repository with the sitemap topic, visit your repo's landing page and select "manage topics."