Skip to content

Offline LLM support

Pre-release
Pre-release

Choose a tag to compare

@Adiii1436 Adiii1436 released this 26 Mar 08:34
· 8 commits to main since this release
  1. Feature: Added support for running LLMs locally on your system.
    • Download mistral-7b-openorca.gguf2.Q4_0.gguf from the GPT4All website.
    • Place model inside models/https://gpt4all.io/index.html.
    • Now see the magic🌠