Skip to content

spv420/LLaMA_chatbot

master
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
1 branch 0 tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
.gitignore
 
 
README.md
 
 
assistant_input.txt
 
 
client.py
 
 
input.txt
 
 
msg.py
 
 
prompt.txt
 
 
requirements.txt
 
 
LLaMA_chatbot WARNING!!! "general install guide"

README.md

LLaMA_chatbot

WARNING!!!

THIS CODE IS FUCKING AWFUL. DO NOT EXPECT IT TO WORK OUT OF THE BOX. I'M GOING TO ATTEMPT TO IMPROVE IT OVER THE NEXT WHILE, BUT FOR NOW, IT'S SHIT.

IF YOU CAN GET IT TO WORK, YOU DESERVE A COOKIE. CHEERS.

"general install guide"

  • install text-generation-webui from oogabooga
  • download the LLaMA weights, whatever is the largest that'll fit on your GPU(s)
  • run text-generation-webui for that model, --listen
  • make a venv python -m venv venv
  • install requirements venv/bin/pip install -r requirements.txt
  • set env MATRIX_{SERVER,USER,PASSWORD,ROOM} to applicable vals, ex: https://synapse.example.com, @AzureDiamond:example.com, hunter2, fancy room ID that's like \![A-Za-z]*:example\.com) respectively
  • run client.py venv/bin/python client.py
  • enjoy

About

(WIP) chatbot for Matrix using Meta's LLaMA model

Topics

python meta ai gpu matrix chatbot cuda conda nvidia llama gpt gpt-3 gpt3 llm chatgpt text-generation-webui

Resources

Readme

Stars

6 stars

Watchers

1 watching

Forks

1 fork
Report repository

Releases

No releases published

Packages

No packages published

Languages