v1.0.0-beta.9
Add configurable FETCH_CAP for ChromaDB pre-rerank pool size
Replaces the hardcoded n_results=5 ChromaDB query limit with a configurable FETCH_CAP (default 75), allowing the lexical reranker to draw from a wider candidate pool before final results are selected.
Changes:
.env: addFETCH_CAP=75config.py: loadFETCH_CAPfrom environmentmain.py: useFETCH_CAPfor the initial ChromaDBn_resultsquery; final result count remains capped at 5 post-rerank (relevant[:5]) as a separate, intentional safety limit on answer scopetodo.md: markfetch_capitem complete
Behavior note: with FETCH_CAP=5 this is a no-op versus prior behavior (identical retrieval). The functional change only takes effect if FETCH_CAP is raised above 5, which widens the reranking candidate pool at the cost of additional ChromaDB/rerank compute per query.
Known follow-up: the post-rerank relevant[:5] cutoff is still hardcoded and should likely become its own named config value (e.g. FINAL_RESULT_COUNT), separate from FETCH_CAP, so both the pre-rerank pool size and the final answer scope are configurable rather than one knob exposed and one fixed.