v0.7.0

What's New

krawl crawl command

Spider a site or crawl URLs from a sitemap with a single command:

• BFS spider with --max-pages, --depth, --concurrency flags
• Auto-detects sitemap URLs (XML sitemaps and sitemap indexes) — no flag needed
• Runs full SEO audit on each page
• Site-wide issue detection: duplicate titles/descriptions, missing canonicals, orphan pages
• Per-page error/warning breakdown with actionable rule names
• JSON output with -j

Extended audit rules

Body parsing & content analysis:

• Heading hierarchy validation (H1-H6 skip detection)
• Image audit (missing alt text, missing width/height dimensions)
• Content metrics (word count, thin content detection, text-to-HTML ratio)
• Redirect chain analysis (>2 hops, mixed HTTP/HTTPS)
• Link metrics (internal/external breakdown, nofollow count, excessive links)

Schema.org validation:

• Required/recommended property checks for 13 schema types (Article, Product, LocalBusiness, Organization, FAQPage, HowTo, BreadcrumbList, and more)
• Rich result eligibility for FAQ, HowTo, Article, Product, and Breadcrumb
• Integrated into --schema flag output

Link quality:

• Generic anchor text detection ("click here", "read more", etc.)
• External domain concentration warnings
• Nofollow distribution analysis
• Empty anchor text detection

Bug fixes

• Fix nil pointer crash in redirect handling during concurrent fetches
• Fix og:title length threshold (60 → 90 chars, matching Facebook's actual truncation)
• Add twitter:description length check (200 char limit per X spec)

v0.6.0

Full Changelog: v0.5.1...v0.6.0

v0.5.1

Full Changelog: v0.5.0...v0.5.1

v0.5.0

Full Changelog: v0.4.0...v0.5.0

v0.4.0

Full Changelog: v0.3.0...v0.4.0

v0.3.0

Full Changelog: v0.2.0...v0.3.0

v0.2.0

Full Changelog: v0.1.0...v0.2.0

v0.1.0

Full Changelog: https://github.com/devforward/krawl/commits/v0.1.0