GPTQ_backend is a backend for the GPT4All-ui project. It provides additional functionality for GPTQ, a variant of GPT that generates questions instead of text.
To install GPTQ_backend, simply run the install.bat or install.sh script and provide the path to the root of your GPT4All-ui folder. The installer will copy the gptq subfolder to the backends folder and install the required libraries inside the virtual environment of GPT4ALL-ui.
On linux/macos :
./install.sh /path/to/GPT4All-uiOn windows :
./install.bat /path/to/GPT4All-uiNote: Replace /path/to/GPT4All-ui with the actual path to the root of your GPT4All-ui folder.
After installation, you can start using GPTQ_backend by running GPT4ALL-ui and selecting "gptq" as the backend.
GPTQ_backend is licensed under the Apache License, Version 2.0. See LICENSE for more information.