Skip to content

v0.12.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 13 Jun 15:39
v0.12.0
This tag was signed with the committer’s verified signature.
iliaal Ilia Alshanetsky
SSH Key Fingerprint: YJsTJCeBYdLkxhRMbIp/36Gyu7iJhaPONpxwWB7lU7c
Verified
Learn about vigilant mode.
00c3b1c
This commit was signed with the committer’s verified signature.
iliaal Ilia Alshanetsky
SSH Key Fingerprint: YJsTJCeBYdLkxhRMbIp/36Gyu7iJhaPONpxwWB7lU7c
Verified
Learn about vigilant mode.

Added

  • The MCP daemon evicts pooled embedder/reranker models after they sit unused (default 15 min, CODESAGE_MODEL_IDLE_SECS, 0 disables), freeing their GPU VRAM and (via malloc_trim) some host memory while keeping the daemon and its client connections alive; the next query reloads them. The daemon now also spawns with MALLOC_ARENA_MAX=2 unless overridden.

Fixed

  • The MCP daemon now reaps stale-version daemons sharing its runtime dir on startup, so a rebuilt or upgraded binary no longer leaves the old daemon pinning a second copy of the embedder + reranker in memory until the idle backstop fires.
  • Structural/metadata commands (status, risk, find-symbol, …) no longer preload the ORT + CUDA stack at startup; only search/index/export and the watch/daemon/mcp --direct servers do. Avoids a CUDA-dlopen abort (exit 134) under restricted sandboxes and the wasted python probe on every structural command.
Assets 2
Loading