RAGchain is a framework for developing advanced RAG(Retrieval Augmented Generation) workflow powered by LLM (Large Language Model). While existing frameworks like Langchain or LlamaIndex allow you to build simple RAG workflows, they have limitations when it comes to building complex and high-accuracy RAG workflows.
RAGchain is designed to overcome these limitations by providing powerful features for building advanced RAG workflow easily. Also, it is partially compatible with Langchain, allowing you to leverage many of its integrations for vector storage, embeddings, document loaders, and LLM models.
Docs | API Spec | QuickStart
pip install RAGchainRAGchain offers several powerful features for building high-quality RAG workflows:
Simple file loaders may not be sufficient when trying to enhance accuracy or ingest real-world documents. OCR models can scan documents and convert them into text with high accuracy, improving the quality of responses from LLMs.
Reranking is a popular method used in many research projects to improve retrieval accuracy in RAG workflows. Unlike LangChain, which doesn't include reranking as a default feature, RAGChain comes with various rerankers.
In real-world scenarios, you may need multiple retrievers depending on your requirements. RAGchain is highly optimized for using multiple retrievers. It divides retrieval and DB. Retrieval saves vector representation of contents, and DB saves contents. We connect both with Linker, so it is really easy to use multiple retrievers and DBs.
We provide pre-made pipelines that let you quickly set up RAG workflow. We are planning to make much complex pipelines, which hard to make but powerful. With pipelines, you can build really powerful RAG system quickly and easily.
It is crucial to benchmark and test your RAG workflows. We have easy benchmarking module for evaluation. Support your own questions and various datasets.
simply install at pypi.
pip install RAGchainFirst, clone this git repository to your local machine.
git clone https://github.com/Marker-Inc-Korea/RAGchain.git
cd RAGchainThen, install RAGchain module.
python3 setup.py developFor using files at root folder and test, run dev requirements.
pip install dev_requirements.txt- Google Search
- Bing Search
- Basic
- Visconde
- Rerank
- Google Search
- Query Decomposition
- Evidence Extractor
- REDE Search Detector
- Semantic Clustering
- Cluster Time Compressor
- MS-MARCO
- Mr. Tydi
- Qasper
- StrategyQA
- KoStrategyQA
- ANTIQUE
- ASQA
- DSTC11-Track5
- Natural QA
- NFCorpus
- SearchQA
- TriviaQA
- ELI5
We welcome any contributions. Please feel free to raise issues and submit pull requests.
This project is an early version, so it can be unstable. The project is licensed under the Apache 2.0 License.