Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
ai
ml
falcon
mpt
llama
mistral
fine-tuning
mlops
bentoml
vicuna
llm
model-inference
llmops
llm-serving
stablelm
llm-inference
open-source-llm
llama2
openllm
llm-ops
-
Updated
May 12, 2024 - Python