Skip to content

0.7.0 - replication, fuzzy canon, filter plugins and more

Compare
Choose a tag to compare
@ato ato released this 14 Jan 04:50
· 154 commits to master since this release

Big new features contributed by James Kafader and Noah Levitt from the Archive-It team at the Internet Archive:

  • Replication
  • Fuzzy canonicalization using pywb-style rules.yaml
  • Request logging
  • RocksDB upgraded to 6.0.1
  • Command line options for tweaking performance
  • Filter plugins
  • New query params
    • urlkey - alternative to url, bypasses outbackcdx canonicalization
    • from - minimum timestamp
    • to - maximum timestamp
    • collapse aka collapseToFirst
    • collapseToLast