Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Uncertainty bands for plot_roc #74

Open
GilesStrong opened this issue Jun 8, 2020 · 0 comments
Open

Uncertainty bands for plot_roc #74

GilesStrong opened this issue Jun 8, 2020 · 0 comments
Labels
good first issue Good for newcomers improvement Something which would improve current status, but not add anything new low priority Not urgent and won't degrade with time

Comments

@GilesStrong
Copy link
Owner

Current status

plot_roc provides a variety of options for computing and plotting ROC curves, including bootstrap resampling to compute the uncertainty on the ROC AUCs.

Deficiency

Whilst the mean ROC AUCs are displayed, along with their uncertainty, the curves that are plotted are just single lines with no uncertainty. Ideally the uncertainty band coming from bootstrap resamples of the data should be used to compute the uncertainty bands.

Probable solution

_bs_roc_auc is extended to compute and return multiple ROC curves. plt.plot is replaced with sns.lineplot and set to show the standard deviation as a band as computed using the ROC curves returned by _bs_roc_auc.

@GilesStrong GilesStrong added good first issue Good for newcomers improvement Something which would improve current status, but not add anything new low priority Not urgent and won't degrade with time labels Jun 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers improvement Something which would improve current status, but not add anything new low priority Not urgent and won't degrade with time
Projects
None yet
Development

No branches or pull requests

1 participant