v0.4.1

Changelog

• 5ad50e0 Hash frontier dedup key to fixed width to prevent long-URL data loss
• ec0010b Merge fix/v0.4.1: dedup-key hashing, shard ceiling, doc fixes
• 692b022 Promote CHANGELOG to 0.4.1
• 5ff9bc7 Reconcile pre-0.4.1 frontier dedup_key on mysql/postgres upgrade
• a703fc2 Reject worker.count beyond the host-shard space; fix stale docs

v0.4.0

Changelog

• 1afe7ac Add "ardvark work" command for cooperative frontier draining
• 74cb07a Add host-affinity sharding and DB-backed per-domain page budget
• ce9771a Add lease-based frontier claiming and global termination
• 1e77f99 Clarify doc comments on driver defaulting, lease clock skew, and worker sharding
• b38edaf Deduplicate lease-clearing updates and crawl/work CLI wiring
• e6def05 Fix page budget blocking re-crawls: gate only new rows, not re-activation
• aeb5dac Guard frontier mutators against lost-lease double processing
• 23062e1 Make Frontier.Counts a single-statement snapshot; document dead-worker stranding
• fc76ead Merge branch 'feat/distributed-crawling'
• ce55e9d Merge branch 'main' into feat/distributed-crawling
• 22ae4ee Merge feat/distributed-crawling: follow catalog/registry pointers in registry search results (d2bc362)
• 3b97a9d Persist frontier item provenance in the DB instead of in-memory maps
• f323a18 Prepare v0.4.0: changelog
• c11529a Shard frontier items on fetch-target host, not attribution host
• 6f8fde4 bump dep
• 35d09e4 feat(ard): recognize media types via mediatype parser, base-aware pointers
• 89a86b1 feat(crawler): follow catalog/registry pointers by Kind, not exact suffix
• d2bc362 feat(crawler): follow catalog/registry pointers found in registry search results
• 8271aac feat(mediatype): classify by semantic Kind with pointer/known helpers
• 393111d feat(mediatype): derive encoding Format hint from suffix/type
• 3e6f17c feat(mediatype): parse media types into type/base/suffix/params
• 7316881 style(mediatype): gofmt test file
• a823c0e test+fix(mediatype): guard profile override on pointers; cover unsuffixed catalog, format-in-message, media_type pass
• e4da3ac tools/smoketest: live 10-worker distributed-crawling smoke test
• b5230c2 tools/smoketest: parameterize frontier backend (DB=mysql|postgres)

v0.3.0

Changelog

• fbb7c2a Add embedded MCP server, --json output, docs page, and ARD dogfooding
• a99dc1c Add info command and config-dir path resolution
• 226dbda Desaturate alternating section background and sidebar scrollbar to near-neutral grays
• 678cfa9 Document info command and ardvark_info MCP tool; brand the sidebar scrollbar
• 8654f5c Fix cross-engine storage portability found by MySQL/MariaDB/Postgres testing
• 6eb36c8 Guard export scan against NULL text columns with portable COALESCE
• 8f14ab7 Keep filldb and profexport dev tools for storage/export perf work
• 6fc4895 Lighter sidebar scrollbar thumb (n-200, matches border tone)
• 1bcb2bc Narrow gray sidebar scrollbar (4px, gray-300); homepage backgrounds unchanged
• 9491cf6 Prepare v0.3.0: changelog, docs availability note
• 1d8e0e1 Restructure docs into guides/reference groups; pluralize summary counts
• 8f99681 Revert "Desaturate alternating section background and sidebar scrollbar to near-neutral grays"
• b9033ca Sidebar scrollbar thumb uses n-100
• b4b4c57 Stream export: constant memory, 2.4x faster on multi-million-row datasets
• de6c233 docs
• 8c7cee5 favicon
• e7c8fb2 website update

v0.2.0

Changelog

• feac53c Add seed curated (awesome-list domains) and seed commoncrawl (web-graph domain ranks)
• b1e0b0e Add seeds/adopters.txt: hosts confirmed publishing ARD catalogs
• 10dec93 Implement FOLLOWUPS: verification hardening, seed sources, housekeeping, release ops
• 48d2e15 Mark completed FOLLOWUPS items done, note the two still-open seed sources
• c3133a8 Prepare v0.2.0: changelog, drop completed FOLLOWUPS doc
• 4713ab1 Refactor per architecture review: fix registry 501 detection, continuous worker pool, dedup helpers

v0.1.0

Changelog

• 8aabc48 Add CT log seeding (seed ct) to design spec
• 48d72fd Add Playwright OG image generator (npm run og), regenerate og.png at 2x
• 7d6054f Add README, website, justfile, goreleaser + brew tap config, CI, ui package, mascots
• ad49ee4 Add ardvark crawler design spec
• d1f86fa Add live crawl rows + seed sources (crtsh, tranco)
• 47bf83d Bump actions/checkout from 4 to 7 (#1)
• 18cf1b0 Bump actions/setup-go from 5 to 6 (#2)
• 906377e Bump goreleaser/goreleaser-action from 6 to 7 (#3)
• 2c9b85b Fix review-found bugs: registry cycle, resumability, verification
• 54ed364 Fix run-summary counters; ignore non-JSON well-known responses
• 5bfb2f4 Implement ardvark crawler: foundation, packages, engine, CLI, integration tests
• c2abe54 Pin goreleaser to 2.15 for cross-platform brew formula; add CHANGELOG
• 1de3b1e Point homepage, OG tags, and UA at ardvark.no
• 0dbad44 Quality pass: dynamic CT logs, urn:ai support, cleaner output
• cd32657 Remove website nav
• a940e9a meme worthy mascots