Skip to content

v0.10.1 — Pickle-Free Index Storage (Security)

Choose a tag to compare

@yifanfeng97 yifanfeng97 released this 14 Sep 01:08
· 119 commits to main since this release

Security release implementing #116: AutoModel/AutoList vector indexes no longer rely on pickle.

🔒 Pickle-Free Index Storage

index/ folders for AutoModel and AutoList KAs are now written as plain JSON (index.json: vectors + documents + ids) and rebuilt in memory on load — no pickle, no code execution. A KA directory is no longer a code-execution vector.

Backward compatibility

  • Legacy KAs (≤ v0.10.0) keep working: load_index() detects pickle indexes and loads them as before, with a deserialization warning.
  • Migration: run he build-index --force <ka> once — the index is re-written in the JSON format (re-embeds all items).
  • Graph/hypergraph/set/document KAs use the OMem index format (separate tracked work).

📚 Docs

Security notes in saving-loading and build-index (EN/ZH) updated to describe both formats and the migration path.

Full changelog: v0.10.0...v0.10.1