Site structure scraper
Switch branches/tags
Nothing to show
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.


Site structure scraper.

The idea is if you want to make a demo of an existing site in a new system, or build an automated site map you could use this tool to get the heirarchy of pages and their relationship to one another and put it into a structure.

Then one could write extensions to export to different CMSs or wireframing tools.


I'm bidding on a new project to redo Huffington Post.

So I run graverobber on it and it pulls down the menus and builds the following:

 - Front page
 - Politics
 - Business
 - Entertainment
 - Tech Media
 - Election 2012
 - Celebrity divorce
 - Hispanic Heritage

etc, etc.

Then it would be easy to at least clone the structure.

If such a tool exists, please let me know before I build it!