console-chat-for-llama-2-7b-chat

Simple console program to chat locally with llama-2-7b-chat

Install

Create subfolder "/model/" and download correct mmodel-file from: https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGUF/tree/main

Install depedencies via pip.

Author

Kristian Virtanen, krisu.virtanen@gmail.com

Commands

---exit ---history

License

GNU General Public License v3.0 https://www.gnu.org/licenses/gpl-3.0.en.html

Slava Ukraini