Skip to content

visiongrep 0.3.0

Choose a tag to compare

@udayj udayj released this 03 Nov 11:03
· 21 commits to main since this release
2dcd085
  • Add visiongrep serve --socket DIRECTORY, an opt-in server that keeps the index and model sessions loaded. Ordinary cached searches for the same directory and index use it automatically while it is running and fall back to one-shot searches otherwise. --no-cache, --reindex, --verify-models and --timing always run one-shot.
  • serve now requires exactly one of --stdio or --socket.
  • Refuse --reindex while a socket server is running for the same index.
  • Save optimized ONNX graphs under models/optimized/ on first use and reuse them in later processes to reduce model startup time (about 578 MiB of extra disk; falls back to the source models if a graph cannot be used or saved).
  • Replace the benchmark harness with benchmarks/bench.py: prepare, paired compare and quality runs, plus aws-run, aws-fetch and aws-list for self-terminating EC2 comparisons.

Measured on AWS c7a.xlarge against v0.2.0: novel text query 6.9% faster, external image query 8.3% faster, 1% changed corpus 8.3% faster, identical results.