#
mlc
Here are 3 public repositories matching this topic...
This project has implemented the RAG function on Jetson and supports TXT and PDF document formats. It uses MLC for 4-bit quantization of the Llama2-7b model, utilizes ChromaDB as the vector database, and connects these features with Lama_Index. I hope you like this project.
-
Updated
May 16, 2024 - Python
-
Updated
Aug 30, 2022 - Python
Improve this page
Add a description, image, and links to the mlc topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mlc topic, visit your repo's landing page and select "manage topics."