This is a simple chatbot built with Llama 3.1 405B.
Follow these steps to set up and run the Llama 3.1 405B chatbot:
-
Clone the GitHub repository:
git clone https://github.com/buildfastwithai/llm-chatbot.git cd llm-chatbot
-
Install the required dependencies:
pip install -r requirements.txt
-
Obtain a Fireworks API key:
- Sign up for an account at Fireworks AI
- Generate an API key from your account dashboard
-
Run the Streamlit app:
streamlit run llama3_chat.py
-
When the app opens in your browser:
- Enter your Fireworks API key in the sidebar
- Start chatting with the Llama 3.1 405B model!
Note: Keep your API key confidential and do not share it publicly.