Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

incremental learning #46

Open
julama opened this issue Dec 31, 2020 · 5 comments
Open

incremental learning #46

julama opened this issue Dec 31, 2020 · 5 comments
Assignees
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@julama
Copy link

julama commented Dec 31, 2020

Hey, thanks for sharing this project!
Is incremental learning supported by smartcore; something like partial_fit from sk-learn?

@VolodymyrOrlov
Copy link
Collaborator

Hi Julian, this is a great direction to explore. I personally do not use partial_fit to train my models, but I can see where incremental learning might be useful. I know Scikit-learn provides only a handful of incremental estimators, which one are you interested in?

@julama
Copy link
Author

julama commented Jan 3, 2021

The reason why I'm interested in partial_fit or mini-batches is that I want to train the model on devices with very restricted memory. At the moment I'm mostly interested in naive bayes and SVM.

Another restriction I have is that I can't use floating-point numbers. I'll try to change the crate math::num::RealNumber to support rust_decimal.

@VolodymyrOrlov
Copy link
Collaborator

We definitely can add partial_fit to the Support Vector Classifier, since the implementation we use is designed for incremental learning.
Naive Bayes was implemented by Luis Moreno but it seems to me that we can add partial_fit to all NB variants we support, do you agree, @morenol?

@julama let me know if you want to work on this issue. In any case we can plan this story for next release (v0.3.0). Also, can I ask you to create a separate issue for rust_decimal (I want to keep these two stories separately)?

@morenol
Copy link
Collaborator

morenol commented Jan 4, 2021

Yes, I think that we can add that support for the NB variants that we have implemented. I can help with that.

@julama
Copy link
Author

julama commented Jan 4, 2021

let me know if you want to work on this issue. In any case we can plan this story for next release (v0.3.0). Also, can I ask you to create a separate issue for rust_decimal (I want to keep these two stories separately)?

Yes, I'm interested to work on it. I just started learning rust but I will give it a try.

@VolodymyrOrlov VolodymyrOrlov added the enhancement New feature or request label Jan 4, 2021
@morenol morenol added the help wanted Extra attention is needed label Sep 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants