creating gguf model from lora adapter #5360
-
I have a ggml adapter model created by convert-lora-to-ggml.py (ggml-adapter-model.bin). Now my doubt is how to create the complete gguf model out of these? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
use the export-lora binary to merge these:
|
Beta Was this translation helpful? Give feedback.
-
Thanks @BarfingLemurs |
Beta Was this translation helpful? Give feedback.
use the export-lora binary to merge these:
./export-lora -m model.gguf -l Lora -o merged-model.gguf