Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow users to mount a cache for models in extractors #182

Open
diptanu opened this issue Dec 17, 2023 · 0 comments
Open

Allow users to mount a cache for models in extractors #182

diptanu opened this issue Dec 17, 2023 · 0 comments

Comments

@diptanu
Copy link
Collaborator

diptanu commented Dec 17, 2023

The extractors currently download all the models every time they start which is wasteful

Pass a --cache-dir to indexify extractor command which is visible to the extractor python lib, and allow extractors to use that directory if they wish to cache stuff outside the container.

Each extractor implementation can decide what they want to do with the cache so we are not making decisions on their behalf besides making the directory available.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant