Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

safeOptRMSE #65

Closed
zachmayer opened this issue Nov 17, 2014 · 1 comment
Closed

safeOptRMSE #65

zachmayer opened this issue Nov 17, 2014 · 1 comment

Comments

@zachmayer
Copy link
Owner

Similar to safeOptAuc, stops ensembling if accuracy decreases. Consider making the safe functions the defaults, and renaming the old functions fastOpt*.

Then we could have a flag to caretEnsemble for safe=TRUE. If TRUE, we use the safe functions, if FALSE we use the slightly faster non-safe functions.

If there's not a big difference between the safe vs non-safe speed, we get rid of the non-safe ones.

@zachmayer zachmayer added this to the 1.0.0 CRAN release milestone Nov 17, 2014
@zachmayer zachmayer added 1.1 and removed v1.0 labels Nov 17, 2014
@zachmayer zachmayer removed this from the 1.0.0 CRAN release milestone Nov 20, 2014
@zachmayer zachmayer added 1.2 and removed 1.1 labels Jan 14, 2015
@zachmayer
Copy link
Owner Author

This shouldn't ever be needed, as I think RMSE is convex. I've never been able to encounter a case where RMSE would converge to worse than the single best model.

AUC, on the other hand, is not convex.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant