We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Each model loading module currently has its own internal cache, with no way to clear them all together.
Add an LRU cache for models to some shared object, probably the ServerContext, and update each loader to use that instead of the module globals.
ServerContext
There should be a way to empty the cache and run garbage collection, on an admin endpoint.
The text was updated successfully, but these errors were encountered:
fix(api): remove finished jobs from worker pool (#124)
feb4603
Successfully merging a pull request may close this issue.
Each model loading module currently has its own internal cache, with no way to clear them all together.
Add an LRU cache for models to some shared object, probably the
ServerContext
, and update each loader to use that instead of the module globals.There should be a way to empty the cache and run garbage collection, on an admin endpoint.
The text was updated successfully, but these errors were encountered: