Skip to content

FrameScout — Offline AI Search: v3.0.1 & ONNX + SigLIP 2 Upgrade

Choose a tag to compare

View all tags
@bobgsning bobgsning released this 07 Aug 09:47
· 2 commits to main since this release
v3.0.1
bbf6ae3

FrameScout v3.0.1 — ONNX + SigLIP 2 Upgrade

Release date: 2026-08-07

This release brings a major AI inference engine overhaul and several UX improvements. FrameScout now runs on ONNX Runtime with Google SigLIP 2 (768‑dimension embeddings), delivering better semantic understanding, broader GPU support, and faster inference.

✨ What's New

  • 🧠 SigLIP 2 Embeddings — Upgraded from OpenAI CLIP (512D) to Google SigLIP 2 (768D). More accurate semantic matching, especially for non-English queries and fine-grained concepts.
  • ⚡ ONNX Runtime — Replaced PyTorch with ONNX Runtime for inference. Automatic hardware acceleration detection:
    • DirectML (AMD / NVIDIA / Intel GPUs on Windows)
    • CUDA (NVIDIA GPU)
    • CPU (fallback)
    • Expect 15–30% faster batch inference compared to PyTorch.
  • 🔽 Low-Score Collapsible Cards — Low-confidence results are now collapsed by default. Click the red prompt bar to expand details, and use the "▲ Collapse" button to hide them again. Cleaner search results.
  • 📦 Fully Offline OCR — EasyOCR model storage is now fixed to models/easyocr/. No unexpected network requests after initial download.

🔧 Improvements

  • Model download script updated to fetch SigLIP 2 ONNX models (run python scripts/download_models.py again).
  • Logging redirected to %TEMP%\FrameScout_Global\ for easier debugging.
  • Improved error handling for video frame extraction with NaN FPS values.
  • Better tag display logic for low-confidence results.

🐛 Bug Fixes

  • Fixed crash when processing video files with corrupted or unknown FPS metadata.
  • Fixed conflicting display between low-score tags and semantic tags.
  • Implemented polling loop with PING_ENGINE until engine responds.
  • Fixed ZMQ REQ state machine by creating fresh socket per attempt.
  • Moved timeout panic out of app.run to ensure early abort.
  • Removed unused outer socket variable.
  • Main socket now created only after engine is confirmed ready.

🗑️ Removed

  • Runtime dependency on PyTorch (still available in requirements.txt for development).

📋 Upgrade Notes

⚠️ Model re-download required.
Due to the switch from CLIP to SigLIP 2, you must re-run python scripts/download_models.py to obtain the new ONNX models. Old CLIP models in models/openai-clip/ are no longer used and can be deleted.

🚀 Quick Start (for new users)

git clone https://github.com/bobgsning/FrameScout.git
cd FrameScout
# Follow instructions in README.md

🙏 Acknowledgments

Built with Google SigLIP 2, ONNX Runtime, EasyOCR, Tauri, ZeroMQ, and the Rust ecosystem.

Full Changelog: v3.0.0...v3.0.1

Did you notice? The packaged exe is only about 4 MB.

Assets 3
Loading