Skip to content

Latest commit

 

History

5 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

TheOgBoat 🚤

The Original AI Chatbot — powered by Groq, LangChain, and Streamlit. Fast, free, and runs the most powerful open-source LLMs in the cloud.

Python Streamlit LangChain Groq License


What is TheOgBoat?

TheOgBoat is the original, no-nonsense AI chatbot that sails through your questions with speed and precision. Built with cutting-edge tools — Groq's blazing-fast inference, LangChain's powerful prompt chaining, and Streamlit's clean UI — TheOgBoat delivers smart answers without any cloud setup or GPU required.


Features

  • Blazing Fast — powered by Groq's ultra-fast LLM inference
  • 🧠 Multiple Models — switch between LLaMA 4, LLaMA 3.3, Qwen3, and more
  • 🎛️ Full Control — adjust temperature and max tokens from the sidebar
  • 💬 Chat History — full conversation memory within each session
  • 🔒 Private & Secure — API keys stored safely, never exposed in code
  • 📊 LangSmith Tracking — monitor and trace every prompt

Demo

User: What is the theory of relativity?
TheOgBoat: The theory of relativity, developed by Albert Einstein...

Getting Started

1. Prerequisites

2. Clone the repo

git clone https://github.com/YOUR_USERNAME/TheOgBoat.git
cd TheOgBoat

3. Install dependencies

pip install -r requirements.txt

4. Set up environment variables

Create a .env file in the root directory:

GROQ_API_KEY=your_groq_api_key_here
LANGCHAIN_API_KEY=your_langsmith_api_key_here

5. Run the app

streamlit run app.py

Project Structure

TheOgBoat/
├── app.py              # Main Streamlit app
├── requirements.txt    # Python dependencies
├── .env                # API keys (never commit this)
├── .gitignore          # Ignores .env and venv
└── README.md

Available Models

Model Best For
llama-3.3-70b-versatile Best overall performance
llama-3.1-8b-instant Fast & lightweight responses
meta-llama/llama-4-scout-17b-16e-instruct Latest Llama 4 capabilities
qwen/qwen3-32b Strong reasoning & logic
openai/gpt-oss-120b Most powerful responses

Environment Variables

Variable Description
GROQ_API_KEY Your Groq API key for LLM inference
LANGCHAIN_API_KEY Your LangSmith key for prompt tracking

Deploying on Streamlit Cloud

  1. Push your code to GitHub (without .env)
  2. Go to share.streamlit.io
  3. Connect your GitHub repo
  4. Go to Advanced settings → Secrets and add:
GROQ_API_KEY = "your_groq_api_key_here"
LANGCHAIN_API_KEY = "your_langsmith_api_key_here"
  1. Click Deploy 🚀

Tech Stack

Tool Purpose
Groq Ultra-fast LLM inference
LangChain Prompt chaining & LLM abstraction
Streamlit Web UI
LangSmith Prompt tracking & observability
python-dotenv Environment variable management

Contributing

Pull requests are welcome! Feel free to open an issue for bugs or feature requests.


License

MIT — feel free to use, modify, and share.


Built with ❤️ by samarthx4216 — TheOgBoat ⛵

About

A local AI chatbot built with Ollama, LangChain, and Streamlit — run open-source LLMs privately on your machine with full LangSmith tracking.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages