Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Averaging 10 ROC curves #108

Closed
martinmargh opened this issue Dec 27, 2022 · 4 comments
Closed

Averaging 10 ROC curves #108

martinmargh opened this issue Dec 27, 2022 · 4 comments
Labels
duplicate Issue is already covered by an other one.

Comments

@martinmargh
Copy link

Hi! I have computed 10 ROC values to test my model's performance (I'm working with GLMMs) with a 10-fold cross-validation. Because I need an averaged value of AUC, I stored my results in a list and saved as an rds file to compute the mean between those curves.
I'm looking for a function or similar to compute the average ROC and AUC with a measure of error (e.g. confidence intervals as the ones provided by the roc or standard deviation estimates).

Thank you!

@xrobin
Copy link
Owner

xrobin commented Dec 27, 2022

Hi, thanks for the report!
Would that be covered by issue #41?

@martinmargh
Copy link
Author

Hi! Yes, I'm exactly looking for a function that takes as input my roc values. Is it available for pROC?
Thank you!

@xrobin xrobin added the duplicate Issue is already covered by an other one. label Dec 29, 2022
@xrobin
Copy link
Owner

xrobin commented Dec 29, 2022

There's code in ci.thresholds that does something like that, but it's not exposed in any way.

@xrobin xrobin closed this as completed Dec 29, 2022
@martinmargh
Copy link
Author

Ok, it seems perfect to compute ci for the averaged roc curve...but I can't find a way to compute this averaged curve.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
duplicate Issue is already covered by an other one.
Projects
None yet
Development

No branches or pull requests

2 participants