Skip to content
A standalone python program that crawls a website and builds it's Site Map XML file.
Python
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
classes
images
.gitignore
LICENSE
Main.py
README.md

README.md

Website Crawler and Site Map Generator

A standalone python program that crawls a website and builds it's Site Map XML file.

This program has a full GUI, making it easy to use and edit the information.

Instructions

  1. Run the program, via the file Main.py
  2. Create or open a project.
    Each project represents a website.
  3. Crawl the project's website, if not done already.
  4. Build the initial Site Map Data or load from a previous save.
  5. Confirm the data for the optional fields is to your liking and, if need be, make the necessary changes to it.
  6. Create the Site Map XML file and place it on your website's root directory.

The program has tooltips with further information when needed.

Extra Information

This program will present itself under the name SiteMapCrawler to the servers it visits.

You can’t perform that action at this time.