Changed
- Smart search is faster on the SigLIP models. The engine that serves SigLIP and SigLIP2 ran one image per forward pass, so a bulk smart-search job paid the per-call dispatch cost on every photo. Images arriving at the same time are now gathered into a single pass, which is where the speed-up comes from: the contributor measured 3 to 4 times the throughput on a bulk job. Models that run on the MLX path, including the default, are unaffected because they were never on this path. By @yppy (immich-ml-metal#7).
Upgrade
brew upgrade immich-accelerator
immich-accelerator setup # if first time or new features require it