Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 

cvauroc: Cross-validated Area Under the Curve (AUC)

Receiver operating characteristic (ROC) analysis is used for comparing predictive models, both in model selection and model evaluation. This method is often applied in clinical medicine and social science to assess the tradeoff between model sensitivity and specificity. After fitting a binary logistic regression model with a set of independent variables, the predictive performance of this set of variables -as assessed by the area under the curve (AUC) from a ROC curve- must be estimated for a sample (the test sample) that is independent of the sample used to predict the dependent variable (the training sample). An important aspect of predictive modeling (regardless of model type) is the ability of a model to generalize to new cases. Evaluating the predictive performance (AUC) of a set of independent variables using all cases from the original analysis sample tends to result in an overly optimistic estimate of predictive performance. K-fold cross-validation can be used to generate a more realistic estimate of predictive performance. To assess this ability in situations in which the number of observations is not very large, cross-validation and bootstrap strategies are useful.

cvauroc implements k-fold cross-validation for the AUC for a binary outcome after fitting a logistic or probit regression model averaging the AUCs corresponding to each fold and bootstrapping the cross-validated AUC to obtain statistical inference and 95% bootstrap bias corrected confidence Intervals (CI). Furthermore, cvauroc optionally provides the cross-validated fitted probabilities for the dependent variable or outcome contained in a new variable named _fit, the sensitivity and specificity for each level of the dependent variable, contained in two new variables named, _sen and _spe and the plot for the mean cvAUC and k-fold ROC curves.

Figure Link

Installation note

To install cvauroc directly from GitHub you need to use a Stata module for installing Stata packages from GitHub, including previous releases of a package. You can install the latest version of the GitHub command by executing the following code in your Stata session:

    net install github, from("https://haghish.github.io/github/")  

then, you can install cvauroc simply using the following code in Stata:

    github install migariane/cvauroc  
    which cvauroc  
    help cvauroc 

To uninstall the package type:

   ado uninstall cvauroc      

Note: the GitHub package only works with the latest versions of Stata >13.1, otherwise you can install manually the package directly downloading the files from the GitHub repository and placing it in your Stata ADO PERSONAL folder.

Updates

In case you have updates or changes that you would like to make, please send me a pull request.
Alternatively, if you have any questions, please e-mail me.
E-mail: miguel-angel.luque at lshtm.ac.uk
Twitter @WATZILEI

Citation

You can cite this repository as:
Luque-Fernandez MA, Redondo-Sanchez D, Maringe C. (2019). Cross-validated Area Under the Curve. GitHub repository, https://github.com/migariane/cvauroc

DOI

Copyright

This software is distributed under the GPL-2 license.

About

Cross-validated Area Under the Curve for ROC Analysis after Predictive Modelling for Binary Outcomes

Resources

License

Packages

No packages published