Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add fastutil primitive collections to reduce memory consumption #58

Closed
pemistahl opened this issue Jun 16, 2020 · 0 comments
Closed

Add fastutil primitive collections to reduce memory consumption #58

pemistahl opened this issue Jun 16, 2020 · 0 comments
Labels
enhancement New feature or request
Milestone

Comments

@pemistahl
Copy link
Owner

Several users reported in the past that Lingua would consume too much memory (e.g. #57). This is partly because of Lingua's design: Her language models are much bigger which is one of the reasons for her better accuracy compared to other language detection libraries.

However, as was tested in earlier versions of the library, the usage of the fastutil primitive collections, especially Object2DoubleMap, might help reduce the memory consumption of the language models and improve runtime performance.

@pemistahl pemistahl added the enhancement New feature or request label Jun 16, 2020
@pemistahl pemistahl added this to the Lingua 1.0.0 milestone Jun 16, 2020
pemistahl added a commit that referenced this issue Jun 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant