Skip to content

0.10.0

Latest

Choose a tag to compare

@hahwul hahwul released this 27 Jun 01:27

0.10.0

  • New providers: arquivo (Arquivo.pt, keyless) and github (GitHub Code Search, via --github-api-key)
  • URLScan now works without an API key (anonymous public search; key remains optional for higher limits)
  • Provider selection: --list-providers, --exclude-providers, and --all-providers
  • Provider attribution per URL via --show-sources (JSON/CSV/plain text)
  • Per-provider summary with --stats
  • Domain input from file with --domain-list FILE (alias --dL)
  • Split output per domain with --output-dir PATH (alias --oD)
  • Separate API-keys-only TOML with --provider-config FILE (so the main config can be committed)
  • Global enumeration ceiling with --max-time SECONDS
  • Per-provider rate limits with --rate-limit-by id=req_per_sec,...
  • Wayback date filtering with --wayback-from / --wayback-to
  • Common Crawl: bump default index to CC-MAIN-2026-17, add --cc-index latest, and accept a comma-separated list of indexes
  • Fix Wayback Machine timeouts on large domains (plain-text CDX, server-side dedup, longer default timeout)

Full Changelog: 0.9.0...0.10.0