Skip to content
Compare
Choose a tag to compare

0.7.0 - replication, fuzzy canon, filter plugins and more

@ato ato released this
· 77 commits to master since this release
Compare
Choose a tag to compare

Big new features contributed by James Kafader and Noah Levitt from the Archive-It team at the Internet Archive:

  • Replication
  • Fuzzy canonicalization using pywb-style rules.yaml
  • Request logging
  • RocksDB upgraded to 6.0.1
  • Command line options for tweaking performance
  • Filter plugins
  • New query params
    • urlkey - alternative to url, bypasses outbackcdx canonicalization
    • from - minimum timestamp
    • to - maximum timestamp
    • collapse aka collapseToFirst
    • collapseToLast