Repository navigation
v0.3.0
Minor Changes
-
de79027: Fix indexing status and add major performance optimizations (5-10x faster)
Bug Fixes:
- Fixed indexing status MCP command returning all zeros for statistics (totalFiles, totalBlocks, totalVectors)
- Status now correctly updates from storage regardless of system state
Performance Improvements (5-10x faster indexing):
- NEW: Cross-file embedding batching - Batch embeddings across multiple files instead of per-file (5-10x faster)
- NEW: Cross-file storage batching - Batch Qdrant upserts across files (2-3x faster)
- NEW: Parallel file discovery - Concurrent directory traversal (2-4x faster)
- NEW: OptimizedBatchProcessor - New processor with all optimizations enabled by default
- Fixed critical memory leak in batch processor concurrency control (60% memory reduction)
- Optimized file change detection to use stats instead of reading entire file contents
- Added explicit memory cleanup between processing cycles
- Reduced default batch sizes (concurrency: 5→3, batch size: 50→20)
- Added pauses between batches to allow garbage collection
New Features:
useOptimizationsconfig option (defaults to true)- Cross-file batching with configurable batch sizes
- Parallel file discovery with configurable concurrency
- Comprehensive performance documentation in PERFORMANCE.md
Breaking Changes: None - optimizations are enabled by default but fully backwards compatible
These changes provide 5-10x faster indexing with 60% less memory usage while maintaining stability.