Skip to content

Commit

Permalink
[Docs] clarification about cardinality accuracy (#34616)
Browse files Browse the repository at this point in the history
Adds a bit more clarification about how accuracy is dependent
on the dataset in question.

Closes #18231
  • Loading branch information
polyfractal committed Oct 22, 2018
1 parent 6a2dff2 commit e259689
Showing 1 changed file with 12 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -150,10 +150,18 @@ public static void main(String[] args) {

image:images/cardinality_error.png[]

For all 3 thresholds, counts have been accurate up to the configured threshold
(although not guaranteed, this is likely to be the case). Please also note that
even with a threshold as low as 100, the error remains very low, even when
counting millions of items.
For all 3 thresholds, counts have been accurate up to the configured threshold.
Although not guaranteed, this is likely to be the case. Accuracy in practice depends
on the dataset in question. In general, most datasets show consistently good
accuracy. Also note that even with a threshold as low as 100, the error
remains very low (1-6% as seen in the above graph) even when counting millions of items.

The HyperLogLog++ algorithm depends on the leading zeros of hashed
values, the exact distributions of hashes in a dataset can affect the
accuracy of the cardinality.

Please also note that even with a threshold as low as 100, the error remains
very low, even when counting millions of items.

==== Pre-computed hashes

Expand Down

0 comments on commit e259689

Please sign in to comment.