Skip to content

Release/v0.2.0 omni rag#3

Merged
yashdesai023 merged 5 commits intomainfrom
release/v0.2.0-omni-rag
Feb 28, 2026
Merged

Release/v0.2.0 omni rag#3
yashdesai023 merged 5 commits intomainfrom
release/v0.2.0-omni-rag

Conversation

@yashdesai023
Copy link
Collaborator

vectorDBpipe v0.2.1 — Enterprise Omni-RAG SDK. Tri-Processing Ingestion + 4 AI Engines (Vector RAG, Vectorless RAG, GraphRAG, Structured JSON Extract) + 15+ data connectors. One pipeline. One API. Zero glue code.

@yashdesai023 yashdesai023 merged commit 4484929 into main Feb 28, 2026
2 checks passed
yashdesai023 added a commit that referenced this pull request Mar 3, 2026
…hunking, PPTX Loader, Backend VDBpipe Upgrade, 39-test Suite, TUI Diagnostics

BREAKING CHANGES: None — fully backwards compatible.

Architecture:
- Refactor VDBpipe to pure composition (remove TextPipeline inheritance, delete _safe_reinit)
- Replace TextPipeline with VDBpipe in backend routers (ingest, chat, retrieve)

Semantic OmniRouter (#3):
- Embedding cosine-similarity intent routing with threshold=0.35
- Pre-computed intent prototype embeddings per engine at startup
- Keyword fallback when embedder unavailable

Persistence (#4):
- Auto-save graph + page_index as JSON after every ingest()
- Auto-load on VDBpipe.__init__() — survives restarts

Streaming (#15):
- BaseLLMProvider.stream_response() with safe default wrapper
- OpenAILLMProvider real SSE streaming (requests stream=True)
- VDBpipe.stream_query() generator
- POST /pipelines/chat/stream SSE endpoint (StreamingResponse)

Data Loading (#13):
- Add PPTX support via python-pptx (_load_pptx)
- Register .pptx in DataLoader.supported_ext

Chunking (#14):
- Add chunk_text_sentences() sentence-boundary sliding-window chunker
- Configurable max_tokens and overlap_sentences
- Old chunk_text() kept for compatibility

Tests (#12):
- Expand from 4 to 39 tests across 12 test classes
- All tests mocked — no GPU/API keys required

TUI (#16, #17, #18):
- System Doctor: 6 real execSync runtime checks
- SetupWizard: setStep(8) on write error (fix silent failure)
- SetupWizard: validateAndSave() with per-provider API key validation

Bug Fixes:
- File isolation: uploads go to data/<user_id>/<uuid>_filename
- Cache eviction on config update in backend

Deps: add python-pptx>=0.6.23 to setup.py install_requires
TUI: bump to v0.1.4, smarter postinstall.cjs (python -m pip)
yashdesai023 added a commit that referenced this pull request Mar 3, 2026
…hunking, PPTX Loader, Backend VDBpipe Upgrade, 39-test Suite, TUI Diagnostics

BREAKING CHANGES: None — fully backwards compatible.

Architecture:
- Refactor VDBpipe to pure composition (remove TextPipeline inheritance, delete _safe_reinit)
- Replace TextPipeline with VDBpipe in backend routers (ingest, chat, retrieve)

Semantic OmniRouter (#3):
- Embedding cosine-similarity intent routing with threshold=0.35
- Pre-computed intent prototype embeddings per engine at startup
- Keyword fallback when embedder unavailable

Persistence (#4):
- Auto-save graph + page_index as JSON after every ingest()
- Auto-load on VDBpipe.__init__() — survives restarts

Streaming (#15):
- BaseLLMProvider.stream_response() with safe default wrapper
- OpenAILLMProvider real SSE streaming (requests stream=True)
- VDBpipe.stream_query() generator
- POST /pipelines/chat/stream SSE endpoint (StreamingResponse)

Data Loading (#13):
- Add PPTX support via python-pptx (_load_pptx)
- Register .pptx in DataLoader.supported_ext

Chunking (#14):
- Add chunk_text_sentences() sentence-boundary sliding-window chunker
- Configurable max_tokens and overlap_sentences
- Old chunk_text() kept for compatibility

Tests (#12):
- Expand from 4 to 39 tests across 12 test classes
- All tests mocked — no GPU/API keys required

TUI (#16, #17, #18):
- System Doctor: 6 real execSync runtime checks
- SetupWizard: setStep(8) on write error (fix silent failure)
- SetupWizard: validateAndSave() with per-provider API key validation

Bug Fixes:
- File isolation: uploads go to data/<user_id>/<uuid>_filename
- Cache eviction on config update in backend

Deps: add python-pptx>=0.6.23 to setup.py install_requires
TUI: bump to v0.1.4, smarter postinstall.cjs (python -m pip)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant