Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More bootstraps and bigger confidence interval support #719

Open
tomato42 opened this issue Oct 26, 2020 · 0 comments
Open

More bootstraps and bigger confidence interval support #719

tomato42 opened this issue Oct 26, 2020 · 0 comments
Labels
enhancement new feature to be implemented good first issue relatively simple changes, good for first time contributors help wanted
Projects

Comments

@tomato42
Copy link
Member

Feature request

Is your feature request related to a problem? Please describe

The analysis.py script provides just one confidence interval: 95%. While that is related to the 2-sigma interval of normal distribution, so in theory allows for easy estimation of bigger confidence intervals (like 3, 4, 5-sigma), it assumes a normal distribution, which the differences don't follow, and may be very different than the Student t distribution too. So it would be nice if those confidence intervals were configurable.

Describe the solution you'd like

The analysis.py should accept an argument that specifies the user-requested CI.
As we use bootstrapping for calculating current CI, we will need to increase the number of bootstraps for bigger CIs.
Given that the number of repeats influences the confidence in the given value, we should allow setting the number
of bootstrap repeats too.

Describe alternatives you've considered

While it can be calculated externally with R, it looks like scipy is faster for doing this.

Additional context

@tomato42 tomato42 added enhancement new feature to be implemented help wanted good first issue relatively simple changes, good for first time contributors labels Oct 26, 2020
@tomato42 tomato42 added this to To do in Usability via automation Oct 26, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement new feature to be implemented good first issue relatively simple changes, good for first time contributors help wanted
Projects
Usability
  
To do
Development

No branches or pull requests

1 participant