v0.2.6

Features & Improvements

• Per-Site Transfers View: Inspect transfers for any mirrored site filtered by category (retrieved, failed, future, disabled) with live count stats and URL substring search.
• Permanent Disabling & Dead Requisites Handling: Defunct third-party assets (such as icons on dead hosts) or specific URL patterns can now be permanently disabled without failing the crawl or preventing the site from reaching done.
• Ignore Patterns Engine: Added ignore pattern matching supporting exact URLs, domains/hosts (deadhost.com, *.deadhost.com), URL prefixes/suffixes, and path globs.
• Interactive Web UI Transfers Drawer: Site headers in the Web dashboard now feature a Transfers drawer with live counters, category filtering, search, and one-click 'Disable URL' and 'Disable Host' actions.
• CLI Transfers & Ignores Management: Added mirror queue subcommands: transfers, disable, enable, ignores, ignore, and unignore.

v0.2.5

Bug Fixes

• mirrord: Fix schema migration on existing databases missing the site column. In v0.2.4, the new index idx_jobs_site_state was evaluated before ALTER TABLE added the site column, causing startup failures on existing databases with no such column: site. The index creation is now sequenced strictly after column migration.

v0.2.4

Features & Improvements

• Fair-share per-host dispatch: The queue scheduler prioritizes idle sites across concurrency slots so that requests across different domains execute in parallel without starvation or random interleaving.
• Hierarchical tree sequence: Within each site, queued URLs execute systematically from parent directories downward into subdirectories.
• Site and subtree controls: Easily pause, resume, quarantine, unquarantine, or cancel entire sites or subtrees via the Web UI or CLI (mirror queue <action> <id>|<prefix>).
• Web UI Site & Subtree view: Added an interactive toggle between Site & Subtree hierarchy view and Flat List view with site/subtree batch buttons and per-job pause/resume controls.
• Per-job pause and resume: Added mirror queue pause <id> and mirror queue resume <id> along with one-click buttons in the Web UI.
• Filtered queue listing: mirror queue list now supports -site <site> and -prefix <prefix> flags.

v0.2.3

Bug Fixes

• mirrorq: Blank-import all mirroring backends so that method sections in config.toml (e.g. [archiveorg], [git], etc.) validate during configuration loading.

v0.2.2

Features

• mirrorq batch enqueue utility:

  • Added mirrorq CLI tool to enqueue URLs directly into the mirrord background daemon.
  • Accepts URLs as command-line arguments.
  • Automatically reads URLs line-by-line from standard input when piped or redirected from a file (or when passing -), ignoring blank lines and # comments.
  • Supports flags -socket (-s), -config (-c), -dest (-d), -quiet (-q), and -version (-v).

• Daemon improvements:

  • In mirrord, auto-detection checks git.ProbeHTTP for web git repositories that lack a .git suffix.
  • Automatically applies default method flags from config.toml when enqueuing jobs without explicit flags.

Packaging & Documentation

• Added mirrorq(1) manual page.
• Included mirrorq and its man page in Debian/Ubuntu packages (.deb) and macOS packages (.pkg).
• Updated README.md with mirrorq usage examples.

v0.2.1

Features

• Authentication for mirrord Web UI and REST API:
  • Password authentication configurable via -password, -password-file, or [daemon.auth] in config.toml.
  • Secure HttpOnly, SameSite=Lax session cookies for web browser sessions.
  • REST API access via Authorization: Bearer <password> or HTTP Basic authentication.
  • OAuth 2.0 / OpenID Connect SSO support ([daemon.auth.oauth]) with Google, GitHub, or generic OIDC providers.
  • User authorization whitelist (allowed-users).
  • Local Unix domain socket remains unauthenticated for local CLI commands (mirror queue).
  • Web dashboard includes login interface, active user indicator, and log out controls.

Documentation

• Updated man/mirrord.1 and README.md documenting authentication options and TOML configuration examples.

v0.2.0

Full Changelog: v0.1.6...v0.2.0

v0.1.6

Full Changelog: v0.1.5...v0.1.6

v0.1.5

Full Changelog: v0.1.4...v0.1.5

v0.1.4

Full Changelog: v0.1.3...v0.1.4