Sitemapper is a Nodejs web spider application for creating web content architecture CSV files including page url, title, description, and keywords. The created CSV can easily be imported into Excel or Pages and turned into a spreadsheet.
Generates a sitemap by crawling your site. Uses streams to efficiently write the sitemap to your drive and runs asynchronously to avoid blocking the thread. Is cappable of creating multiple sitemaps if threshold is reached. Respects robots.txt and meta tags.