Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for effect sizes and confidence intervals #124

Merged
merged 7 commits into from May 24, 2021

Conversation

fitzgen
Copy link
Member

@fitzgen fitzgen commented May 21, 2021

Fixes #90.

Fixes #89 (if the baseline is within the effect size's CI then it isn't statistically significant).

Calculates the effect size (and associated confidence interval) between the
results for two different engines.

Also, the `analyze` subcommand was renamed to `summarize`.
@fitzgen fitzgen requested a review from abrown May 21, 2021 21:50
crates/data/src/lib.rs Outdated Show resolved Hide resolved
crates/data/src/lib.rs Outdated Show resolved Hide resolved
crates/data/src/lib.rs Outdated Show resolved Hide resolved
fitzgen and others added 4 commits May 24, 2021 10:16
Co-authored-by: Andrew Brown <andrew.brown@intel.com>
Co-authored-by: Andrew Brown <andrew.brown@intel.com>
@fitzgen fitzgen merged commit 10452ee into bytecodealliance:main May 24, 2021
@fitzgen fitzgen deleted the effect-size branch May 24, 2021 18:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

sightglass-next: add effect size confidence intervals sightglass-next: add statistical significance test
2 participants