Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Would it be possible to add the Bloom model and other multilanguage/multilingual models? #4406

Open
asterbini opened this issue May 13, 2024 · 1 comment
Labels
model request Model requests

Comments

@asterbini
Copy link

asterbini commented May 13, 2024

It would be nice, for us non-English people, to have access to the some good multilanguage/multilingual LLMs.
Bloom comes to mind, but other would be very useful.

https://huggingface.co/blog/bloom

@asterbini asterbini added the model request Model requests label May 13, 2024
@asterbini asterbini changed the title Would it be possible to add the Bloom model and other multilanguage models? Would it be possible to add the Bloom model and other multilanguage/multilingual models? May 13, 2024
@thinkverse
Copy link

Yes, Bloom's BloomForCausalLM architecture is supported by llama.cpp. There are 2 1B Bloom models on Ollama already which were added by a community member:

You can convert models yourself by using the import guide, make sure you use convert-hf-to-gguf.py and not convert.py during the convert the model step, and don't use Python 3.12 or later that's not supported yet. I've had success converting models using Python 3.11.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
model request Model requests
Projects
None yet
Development

No branches or pull requests

2 participants