Skip to content

v0.8.0

Choose a tag to compare

@moritzmucha moritzmucha released this 03 Mar 23:15
· 76 commits to main since this release

Changelog

Features

  • All-new Rust backend with a remix of the folly-based implementation by @MnO2 and the "OnlineTdigest" suggestion by @kvc0 (but still using the original estimate_quantile and estimate_rank methods by @andylokandy because of their better numerical precision)
  • This enables another massive speedup of ~30x for update, up to ~10x for serial merge operations, and ~1.5x for batch_update
  • New sum() method

Breaking changes

  • max_centroids can no longer be None
  • the lowest/highest centroid are no longer automatically the min/max of the ingested values - therefore explicit "min" and "max" keys are necessary for serialization

Known issues

  • max_centroids isn't completely precise anymore - digests will sometimes have 1 more centroid than "allowed"
  • serialization is faulty in this version - use v0.8.1+