GitHub - asvch/ask_cricket: LLM AI chatbot using Advanced Retrieval Augmented Generation (RAG), Langchain, and Streamlit to answer questions about the rules of Cricket.

Advanced Retrieval Augmented Generation (RAG) chatbot to ask questions about the rules of Cricket!

LangChain, Streamlit, and OpenAI API
Query rewriting (pre-retrieval) and prompt compression (post-retrieval)
Chroma database as external vectorstore
Ragas metrics to evaluate system
- Answer Relevancy score of ~97%, Context Precision score of ~97%, and Context Recall score of 100%

Note: Can be easily modified to Q&A chatbot for any set of documents.

Preview:

Only answers questions relating to documents, and does not hallucinate answers to unrelated questions:

All PDF documents in data folder containing the rules of Cricket are from https://www.mumbaicricket.com/mca/Laws_of_Cricket.php, and more documents can be added to folder to expand knowledge of application.

Name		Name	Last commit message	Last commit date
Latest commit History 13 Commits
chromadb_cricket		chromadb_cricket
data		data
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
ask_anything_cricket.py		ask_anything_cricket.py
evaluate_rag.py		evaluate_rag.py
evaluation_results.csv		evaluation_results.csv
requirements.txt		requirements.txt