🚀 The feature, motivation and pitch
We need to add support for Anthropic API, at least for the /v1/messages endpoint, in order to support applications that depend on it like Claude Code.
There are routers that implement the endpoint by wrapping the OpenAI api server from vLLM, like https://github.com/musistudio/claude-code-router and https://github.com/1rgs/claude-code-proxy
I'm not sure the difficulty, but I think it shouldn't be difficult and hopefully should be able to be added as a new endpoint within vllm serve
Alternatives
No response
Additional context
No response
Before submitting a new issue...
🚀 The feature, motivation and pitch
We need to add support for Anthropic API, at least for the
/v1/messagesendpoint, in order to support applications that depend on it like Claude Code.There are routers that implement the endpoint by wrapping the OpenAI api server from vLLM, like https://github.com/musistudio/claude-code-router and https://github.com/1rgs/claude-code-proxy
I'm not sure the difficulty, but I think it shouldn't be difficult and hopefully should be able to be added as a new endpoint within
vllm serveAlternatives
No response
Additional context
No response
Before submitting a new issue...