Skip to content

creating gguf model from lora adapter #5360

Answered by BarfingLemurs
ragesh2000 asked this question in Q&A
Discussion options

You must be logged in to vote

use the export-lora binary to merge these:

./export-lora -m model.gguf -l Lora -o merged-model.gguf

Replies: 2 comments

Comment options

You must be logged in to vote
0 replies
Answer selected by ragesh2000
Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants