Update Dockerfile.buildkit

[tvhdev]

corrected model download directory

Describe your changes

the model download directory was wrong

Issue ticket number and link

Checklist before requesting a review

• [X ] I have performed a self-review of my code.
• If it is a core feature, I have added thorough tests.
• I have added thorough documentation for my code.
• I have tagged PR with relevant project labels. I acknowledge that a PR without labels may be dismissed.
• If this PR addresses a bug, I have provided both a screenshot/video of the original bug and the working solution.

Demo

Steps to Reproduce

Notes

[cebtenzzre]

Why wouldn't we use GGUF models with the API? Everything in models2.json is in the GGUF directory.

[tvhdev]

I just tried launching a container with this change, now "Magic Bytes" in the bin file dont match expected valuesAm 20.10.2023 18:24 schrieb cebtenzzre ***@***.***>: Why wouldn't we use GGUF models with the API? Everything in models2.json is in the GGUF directory. —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: ***@***.***>

[cebtenzzre]

Oh, I just noticed that this script is still set to use the old ggml-mpt-7b-chat.bin model. We need to update it to use a GGUF model instead.

[cebtenzzre]

@AndriyMulyar Since you merged this, do you know how this works at all if it is using the old GGML format?

[AndriyMulyar]

The documentation referencing ggML will work as long as the python version is pinned to a pre-2.x version.

[cebtenzzre]

as long as the python version is pinned to a pre-2.x version

Where is it pinned? The gpt4all_api requirements.txt just lists gpt4all>=1.0.0.