Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pickle can't save DeepcutTokenizer #45

Closed
Zylinks opened this issue Oct 4, 2018 · 3 comments
Closed

Pickle can't save DeepcutTokenizer #45

Zylinks opened this issue Oct 4, 2018 · 3 comments

Comments

@Zylinks
Copy link

Zylinks commented Oct 4, 2018 •
edited by titipata

I try to save DeepcutTokenizer with pickle but got the following error
image
image
@Zylinks
Copy link
Author

Zylinks commented Oct 4, 2018

But i save CountVectorizer is fine
image
image

@Zylinks Zylinks changed the title How to save DeepTokenizer Pickle can't save DeepTokenizer Oct 9, 2018
@titipata
Copy link
Collaborator

titipata commented Nov 6, 2019 •
edited

@Zylinks, I'm not sure if this issue is resolved. Can you try the solution from the following stack overflow post if it works: https://stackoverflow.com/questions/30843011/save-and-reuse-tfidfvectorizer-in-scikit-learn?

@titipata titipata changed the title Pickle can't save DeepTokenizer Pickle can't save DeepcutTokenizer Nov 6, 2019
@titipata
Copy link
Collaborator

titipata commented Nov 6, 2019

@Zylinks I added documentation on how to load and save DeepcutTokenizer via 40adc26. You can find the instruction in README. Let me know if you can successfully save/load it :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@titipata @Zylinks