You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I defined a simple 1 tool (filesystem) mcp.json file as per the documentation and verified that it ran. Then tried:
'rapid-mlx serve qwen3.5-4b --enable-auto-tool-choice --tool-call-parser qwen --mcp-config /Volumes/AI/mcp.json'. I got the following:
INFO:vllm_mlx.mcp.config:Loading MCP config from: /Volumes/AI/mcp.json
INFO:vllm_mlx.mcp.manager:Starting MCP client manager with 0 servers
INFO:vllm_mlx.mcp.manager:MCP manager started: 0/0 servers, 0 tools available
INFO:vllm_mlx.server:MCP initialized with 0 tools
Tried this:
curl http://localhost:8000/v1/mcp/status
{"detail":"Not Found"}%
And this:
curl http://localhost:8000/v1/mcp/tools
{"tools":[],"count":0}%
I get the same result (no tools) when i use 'auto' for --tool-call-parser
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
I defined a simple 1 tool (filesystem) mcp.json file as per the documentation and verified that it ran. Then tried:
'rapid-mlx serve qwen3.5-4b --enable-auto-tool-choice --tool-call-parser qwen --mcp-config /Volumes/AI/mcp.json'. I got the following:
INFO:vllm_mlx.mcp.config:Loading MCP config from: /Volumes/AI/mcp.json
INFO:vllm_mlx.mcp.manager:Starting MCP client manager with 0 servers
INFO:vllm_mlx.mcp.manager:MCP manager started: 0/0 servers, 0 tools available
INFO:vllm_mlx.server:MCP initialized with 0 tools
Tried this:
curl http://localhost:8000/v1/mcp/status
{"detail":"Not Found"}%
And this:
curl http://localhost:8000/v1/mcp/tools
{"tools":[],"count":0}%
I get the same result (no tools) when i use 'auto' for --tool-call-parser
Not sure what to try from here...
Beta Was this translation helpful? Give feedback.
All reactions