Skip to content

v2.11.0 - Incremental Ingestion, Chunk Cache & Doc Graph Linking

Choose a tag to compare

@spelech spelech released this 26 Aug 18:17
· 65 commits to main since this release

What's New in v2.11.0

🚀 True Incremental Git Syncing

  • File-level SHA256 content hashing (compute_git_repo_delta) detects Added, Modified, Deleted, and Unchanged files.
  • Skips re-indexing on empty commit changes (0 file deltas).
  • Scopes vector store purges (delete_by_path) and SQLite metadata deletions strictly to Modified and Deleted files without wiping the entire repository index.
  • Ingests Added and Modified files in chunked batches of 25 files with full rollback and error resilience.

⚡ Chunk-Level SHA256 Embedding Cache

  • Adds embedding_cache table in SQLite to cache chunk hash -> dense & sparse embeddings.
  • Bulk cache lookups before calling FastEmbed ONNX or LiteLLM API, ensuring identical code and documentation chunks are never re-embedded across commits, branches, or re-indexes.
  • Added MAX_FILE_SIZE_BYTES (500KB) guard to skip oversized or minified bundle artifacts.

🕸️ Markdown & Wikilink Topology Graph Extraction

  • Extracts standard relative markdown links [Title](../path/to/doc.md) and Obsidian wikilinks [[Doc Name]] / [[Doc Name|Label]] into ast_relationships with relationship type DOC_LINKS_TO.
  • Dynamically generates graph edges between documentation nodes in the visual topology graph.

🧪 Test Coverage

  • 502 total automated tests (380 backend, 96 frontend, 26 E2E) passing with 100% success rate.