Repository navigation
SiteMapper V1.0.0 Production Release
SiteMapper V1.0.0
SiteMapper by Tekzilver is a high-performance desktop web crawler and XML sitemap generator designed for technical SEO audits, site architecture mapping and search engine indexation.
Key Capabilities
- High-Speed Multi-Threaded Crawling: Fast URL discovery with customizable crawl depth, page limits, and request concurrency.
- Unlimited URL Discovery: Free from page caps, credit locks, or subscription tiers.
- Search Engine Compliance: Automatically adheres to
robots.txtdirectives, canonical tags, andnoindexmeta rules. - HTTP & Link Diagnostics: Real-time breakdown of response status codes (200 OK, 301/302 Redirects, 404 Broken Links), MIME types, and page response latency.
- Multiple Export Formats:
- Standard XML Sitemap (
sitemap.xml) - Compressed Gzip Sitemap (
sitemap.xml.gz) - Sitemap Index (automatic chunking for 50,000+ URL websites)
- CSV Spreadsheet & Plain Text URL list
- Static HTML Sitemap
- Standard XML Sitemap (
- Search & URL Filtering: Instant filtering by status code, response time, depth level, or URL path.
- Local & Private Execution: All crawling runs entirely on your local machine with no external proxies or third-party telemetry.
Installation Instructions
- Download
SiteMapper Setup 1.0.0.exefrom the Assets section below. - Run the installer and follow the setup prompt.
- Launch SiteMapper from your Desktop or Start Menu.
Notice on Network Permissions
When launching SiteMapper for the first time, Windows Defender or Windows Firewall may request permission to allow network communication:
"Allow SiteMapper to communicate on private and public networks"
This is standard Windows behavior for desktop web crawlers that initiate outbound HTTP/HTTPS connections to inspect remote web servers. It is completely safe to select "Allow access" to enable crawling.
Acceptable Use & Responsible Crawling Notice
SiteMapper is engineered for website owners, webmasters and developers to audit and map their own web properties. Please crawl responsibly:
- Only crawl domains you own or have explicit authorization to index.
- Configure polite request delays when crawling low-bandwidth or shared hosting environments.
- Do not use this software for unauthorized scraping or stress-testing third-party infrastructure.
System Requirements
- Operating System: Windows 10 or Windows 11 (64-bit)
- Memory: 2 GB RAM minimum (4 GB recommended for larger crawls)
- Disk Space: ~250 MB free storage
