Skip to content

shell-nlp/gpt_server

Error
Looks like something went wrong!

About

gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。

Topics

tts openai llama gpt infinity embedding asr text-moderation llm prompt-injection vllm fastchat function-calling rerank sglang lmdeploy

Resources

Readme

License

Apache-2.0 license
Activity

Stars

194 stars

Watchers

4 watching

Forks

16 forks
Report repository

Releases 17

gpt_server v0.5.1 Latest
Jun 21, 2025
+ 16 releases

Languages