Free and open-source desktop app for technical SEO audits. Crawl any website and get a full breakdown of issues — like Screaming Frog, but free and with no crawl limits.
Built with NativePHP + Laravel + Livewire + Tailwind CSS. No paid external dependencies.
| SEO Spider | Screaming Frog | |
|---|---|---|
| Price | Free and open-source | $259/year |
| Crawl limit | No limits | 500 URLs (free) |
| Code | AGPL-3.0 | Proprietary |
| Platform | Linux (Windows/macOS coming soon) | Windows, macOS, Linux |
| Technology | PHP 8.5 + NativePHP + Livewire | Java |
Download the latest version from the releases page.
| Platform | Format |
|---|---|
| Linux | .AppImage, .deb |
| Windows | Coming soon |
| macOS | Coming soon |
Broken Links — HTTP errors, redirect chains, mixed protocols
Meta Data — Missing or incorrect titles, descriptions, H1, viewport
Directives — noindex, nofollow, canonical conflicts
Headings — Hierarchy, missing H2s, heading order
Content — Thin pages, empty pages
Images — Missing alt text, overly long alt attributes
Performance — Slow responses, oversized pages
Security Headers — CSP, X-Frame-Options, HSTS, Referrer-Policy
Hreflang — Invalid language/region codes, missing self-references
Duplicates — Exact (SHA-256) and near (SimHash) duplicates
- Overview with status code, response time, crawl depth, and issue charts
- Sortable table with 14 columns across 9 filterable tabs
- Detail panel with SEO info, SERP preview, and link analysis
- External link verification via HEAD requests
- CSV export per tab
- Folders to organize your audits
- Pause and resume crawling at any time
- Light and dark mode
- Configurable crawl limits and robots.txt policy
- Full website crawling with no limits
- 10 built-in SEO analyzers
- Dashboard with charts and metrics
- Exact (SHA-256) and near (SimHash) duplicate detection
- External link verification
- SERP preview in detail panel
- CSV export
- Light and dark mode
- Folders to organize audits
- Pause / resume crawling
- Built-in auto-updater
- Windows support
- macOS support
- JavaScript rendering crawl (SPA)
- Exportable PDF reports
# Requirements: PHP 8.5+, Node 22+, Composer
git clone https://github.com/MarioDevv/web-scrapper.git
cd web-scrapper
composer install
npm install
composer run native:devFound a bug? Open an issue. Want to contribute code? PRs are welcome.
vendor/bin/phpunit
vendor/bin/phpstan analyse src
vendor/bin/pintAGPL-3.0 © Mario Perez
Commercial license available for proprietary use or SaaS integration. Contact: perezmario.info@gmail.com.