Skip to content

QVAC SDK v0.8.3

Choose a tag to compare

@github-actions github-actions released this 13 Apr 14:47
· 1792 commits to main since this release

馃摝 NPM: https://www.npmjs.com/package/@qvac/sdk/v/0.8.3

This release fixes a race condition in the KV cache save path during tool-calling completions, improving stability for multi-turn conversations that use tool integration.


馃悶 Bug Fixes

KV Cache Save Race Condition in Tool-Calling Completions

The KV cache save during tool-calling completions could race with ongoing inference because the session path was not passed to the save command and the save response was not awaited. This could result in corrupted or missing session state between tool-call rounds.

The fix ensures the save command receives the correct session path and the SDK awaits the save response before proceeding. If the save fails, the error is now logged as a warning instead of propagating as an unhandled exception, so inference can continue gracefully.

What changed:

  • The cache save now explicitly passes the session path alongside the save instruction, preventing the addon from writing to a stale or missing path
  • The save response is awaited so subsequent inference steps don't race against an in-flight disk write
  • A new logCacheSaveError helper captures save failures as warnings, keeping the completion stream alive even if the cache write fails

馃摌 Documentation

  • Added npm keywords to package.json for better discoverability on the npm registry, covering AI/ML, inference engines, supported platforms, and P2P capabilities.
  • Added a link to the consolidated plaintext documentation export (llms-full.txt) in the SDK README for AI/LLM tool consumption.