- Variety of robust Discord slash commands to assist with various topics from conversation to writing.
- Several experimental warpers and processors such as top_a, Tail Free Sampling, and logit_bias to help customize conversations and text generation.
- Many settings for customizability, all of which can be set through a Settings Builder Web UI.
- A Front End and Back End, allowing for either running both locally or between two different computers.
A Demo of features can be found here.
Each part of the project has its own simple installation guide- including the front end, back end, and settings builder(only needed for offline use).
- Create your Discord Bot and settings JSON file via the settings builder and save it into the config folder of the front end.
- Run the back end on your favorite port.
- Run the front end with the settings file as a command line argument.
That's all you need to run the entirety of the project!
- LLama support
- Introduction of various options, such as loading models in int4, low CPU mode, etc..
- Overhaul of the Settings Builder UI
This project would not have been possible without its wonderful contributors!