README.md

LLM Zoomcamp 2024

This repository hosts my customized version of LLM Zoomcamp 2024 from DataTalks Club. In progress ...

LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI bot that can answer questions about your knowledge base.

Syllabus

1. Introduction to LLM and RAG

Module: 01-introduction/

Contents

• Intro to LLMs and RAG
• Preparing the environment
• Retrieval and the basics of search
• OpenAI & Google API's
• Simple RAG with Gemini model
• Elastic Search

Bonus: streamlit UI for RAG

streamlit run src/app.py

2. Open-source LLMs

Module: 02-open-source/

Contents

• Getting an environment with a GPU
• Open-source models from HuggingFace Hub
• Running LLMs on a CPU with Ollama

References

• LLM Zoomcamp from DataTalks Club