Skip to content

v4.3.0 — Async Reindex, GPU CUDA 12, 13th MCP Tool

Choose a tag to compare

View all tags
@lyonzin lyonzin released this 17 Jun 21:49
v4.3.0
e04dbff

Highlights

Async Background Reindex

reindex_documents() now runs in a background daemon thread and returns immediately — no more MCP timeouts on large document sets (5K+ files). Concurrent calls return already_running with current progress.

New MCP Tool: get_reindex_status

Lightweight progress polling without computing full index stats. Returns active/idle status, percent, processed/total, errors, and last result. 13 MCP tools total.

GPU CUDA 12 Support

Full NVIDIA GPU acceleration with automatic DLL discovery. The [gpu] pip extra installs onnxruntime-gpu + 7 CUDA 12 runtime packages. Server runs 4-step GPU verification on startup (providers → DLLs → nvidia-smi → session test) and falls back to CPU gracefully.

What's Changed

  • NEW: get_reindex_status MCP tool for reindex progress polling
  • NEW: reindex_documents runs async in background thread
  • NEW: GPU CUDA 12 support with 8 nvidia pip packages and auto DLL path discovery
  • NEW: 4-step GPU verification (providers, DLLs, nvidia-smi, ONNX session test)
  • DEPS: [gpu] extra expanded from 3 to 8 packages
  • FIX: GPU status no longer falsely reports ACTIVE when CUDA DLLs are missing
  • DOCS: GPU section rewritten, tool reference updated for 13 tools
  • TEST: Backwards-compat baseline updated for 13 MCP tools

Full Changelog: v4.2.0...v4.3.0

Full Changelog: v4.2.0...v4.3.0

Assets 2
Loading