Skip to content

v0.5.1: RAG Search Fix for Parent Chunks

Choose a tag to compare

View all tags
@assareh assareh released this 27 Nov 08:05
· 76 commits to main since this release
v0.5.1
96f531d

Bug Fix

Fix parent chunks without children not being indexed for RAG search

Parent chunks that have no children were not being added to the search index, causing intro content to be missing from search results.

The Problem

  • The previous fix (v0.5.0, commit 391f78a) correctly captured intro content before the first heading into parent chunks
  • However, those chunks were not searchable because only child chunks were indexed
  • This affected pages where intro content has many small paragraphs (each < 150 tokens)
  • Example: The Vault seal/unseal page intro content ("In this state, Vault can access the physical storage...") was captured but not searchable

The Solution

  • Parent chunks without children are now added directly to the searchable index
  • A flag (is_parent_as_child) indicates these are parent chunks indexed directly
  • This ensures all content is searchable regardless of paragraph size

To Update

After updating, you'll need to rebuild your RAG index:

rm -rf ./your_doc_index  # Delete cached RAG index
# Restart your application to rebuild

Full Changelog: v0.5.0...v0.5.1

Assets 2
Loading