GGML conversion of Zicklein (a German Alpaca LoRa for LLaMA). Compatible with llama.cpp version master-2d43387 or later.
The model is stored on the HuggingFace 🤗 Hub.
The script of the conversion process is in convert.sh
. The model can be uploaded using upload-model.sh
. Make sure to specify a commit message, e.g. ./upload_model.sh add new version
.
Install python3 and git, then install the python requirements in requirements.txt
, e.g.:
pip install -r requirements.txt