Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SVC massively overfits on multiclass data sets? #82

Closed
rhiever opened this issue Feb 16, 2016 · 0 comments
Closed

SVC massively overfits on multiclass data sets? #82

rhiever opened this issue Feb 16, 2016 · 0 comments

Comments

@rhiever
Copy link
Contributor

rhiever commented Feb 16, 2016

In one of my latest commits, I removed the SVC model operator because I noticed it was massively overfitting on the MNIST data set. For example, it would achieve a 99% accuracy on the internal TPOT validation set, but would drop to ~30% accuracy on the external validation set. I'm not sure if this is a known issue with SVC, but I'm simply removing it in the meantime to prevent this from happening.

Hopefully the sklearn-benchmarks project that we're working on will shed some light on what's going on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant