[Feature] ML model preloading #7411
Closed
bo0tzz
started this conversation in
Feature Request
Replies: 1 comment
-
Implemented in #7540 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
The feature
Add an
IMMICH_MODEL_PRELOAD
environment variable to the machine-learning container. Any models listed (comma-separated) in this env var are loaded immediately on startup of the container, and kept in memory (ie not unloaded after the ttl expiry). This is primarily useful for search response times on the CLIP text model.Platform
Beta Was this translation helpful? Give feedback.
All reactions