Skip to content

A standalone python program that crawls a website and builds it's Site Map XML file.

License

Notifications You must be signed in to change notification settings

PedroHenriques/Crawler_SiteMapGenerator

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Website Crawler and Site Map Generator

A standalone python program that crawls a website and builds it's Site Map XML file.

This program has a full GUI, making it easy to use and edit the information.

Instructions

  1. Run the program, via the file Main.py
  2. Create or open a project.
    Each project represents a website.
  3. Crawl the project's website, if not done already.
  4. Build the initial Site Map Data or load from a previous save.
  5. Confirm the data for the optional fields is to your liking and, if need be, make the necessary changes to it.
  6. Create the Site Map XML file and place it on your website's root directory.

The program has tooltips with further information when needed.

Extra Information

This program will present itself under the name SiteMapCrawler to the servers it visits.

About

A standalone python program that crawls a website and builds it's Site Map XML file.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages