How should I download and use a split model? #1996
Unanswered
Taikono-Himazin
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
How should I download and use a split model?
to yaml
name: gpt-4
mmap: true
parameters:
model: huggingface://TheBloke/Swallow-70B-instruct-GGUF/swallow-70b-instruct.Q8_0.gguf
Even if I specified it, it didn't work properly.
Beta Was this translation helpful? Give feedback.
All reactions