Chat-With-OPD (On-Premise-Data)

Objective

• Offline Multi-Modal RAG (Retrieval Augmented Generation) System.
• Uses Mistrial-7B for Text and whisperX for Audio.
• Precise References through dynamic size data chunks, clustered and indexed by contextual similarities.
• Execution Scripts optimized for Intel, CUDA.
  • Apple Silicon Optimization is subject to availability.
• Has flexibility to use any LLMs, Inference Models, Optimizations, DBs, Scalability Paradigms etc.

Concept Overview

System Design will be shared soon.

Contributions Welcome!

Your interest in contributing to the project is highly respected.
Aiming for collaborative excellence, your insights, code improvements, and innovative ideas are highly appreciated.