Skip to content

bentoml/OpenLLM

Error
Looks like something went wrong!

About

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

bentoml.com

Topics

llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving llm-inference open-source-llm llama2 openllm llm-ops llama3-1 llama3-2 llama3-2-vision

Resources

Readme

License

Apache-2.0 license

Code of conduct

Code of conduct

Security policy

Security policy
Activity
Custom properties

Stars

11.3k stars

Watchers

58 watching

Forks

727 forks
Report repository

Releases 147

v0.6.30 Latest
Apr 21, 2025
+ 146 releases

Contributors 31

+ 17 contributors

Languages