You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It would be nice, for us non-English people, to have access to the some good multilanguage/multilingual LLMs.
Bloom comes to mind, but other would be very useful.
asterbini
changed the title
Would it be possible to add the Bloom model and other multilanguage models?
Would it be possible to add the Bloom model and other multilanguage/multilingual models?
May 13, 2024
Yes, Bloom's BloomForCausalLM architecture is supported by llama.cpp. There are 2 1B Bloom models on Ollama already which were added by a community member:
You can convert models yourself by using the import guide, make sure you use convert-hf-to-gguf.py and not convert.py during the convert the model step, and don't use Python 3.12 or later that's not supported yet. I've had success converting models using Python 3.11.
It would be nice, for us non-English people, to have access to the some good multilanguage/multilingual LLMs.
Bloom comes to mind, but other would be very useful.
https://huggingface.co/blog/bloom
The text was updated successfully, but these errors were encountered: