Repository navigation
LibreChat-AI 0.8.8 and wrong tool calling? #17413
Replies: 5 comments 6 replies
|
Please paste relevant logs that were created when reproducing the error. Log locations:
There are two types of logs that can help diagnose the issue:
Error logs contain exact stack traces and are especially helpful, but both can provide valuable information. Please only include the relevant portions of logs that correspond to when you reproduced the error. Also using langfuse here will help to trace the agent flow |
|
This looks like a model-side tool-naming problem rather than a bug in your FastMCP server. LibreChat registers MCP tools as Things that usually fix it with local models:
If it still happens with a large context, compare against a model with stronger tool calling. That will show whether it's the model or the setup. |
|
Thanks for all the responses so far. I look at the various debug logs but couldn't really find anything in there pointing to one issue or another. I did run a langfuse trace and ran that trace (along with my code) through Claude Sonnet 5.5, and it stated it could not find anything wrong with my code and made a few recommendations regarding MCP and MCP Tool instructions. I am still doing research and trying various things, but have not yet had much success. Of course, the Agent / LLM does pick up on the failures and eventually gets it right .. I just hate seeing the first few MCP server calls as "Failed". |
|
The root cause is the naming mismatch between LibreChat's internal MCP tool registry and the OpenAI-compatible function calling format sent to Ollama: Why this happens
How to eliminate the initial failed call
|
|
Thanks everyone for all the responses. I am still struggling through this and will try those latest recommendations. I will report back / mark-as-resolved once I get this thing sorted out. |
Uh oh!
There was an error while loading. Please reload this page.
Good day everyone!
I am relatively new to LibreChat and enjoying it immensely, but I have the hardest time getting it to properly perform tool calling. I am not sure if this is a LibreChat issue, a LLM issue or a user issue ...
Here some initial information:
LibreChat 0.8.8 in Docker, integrated with Ollama using Qwen3.8:27b as the model.
I developed my own MCP server using FastMCP.
When I ask LibreChat to lookup system information for one of my servers, it knows it needs to call my MCP Server. However, the initial MCP Server Calls always result in a [ON_TOOL_EXECUTE] Tool "get_computer_system" not found error.
Ran 2 actions: get_computer_system, my-mcp-server
Failed: get_computer_system Tool get_computer_system not found:
Error: Tool get_computer_system not found
Details
Error: Tool get_computer_system not found
Please fix your mistakes.
thoughts
The tool name is get_computer_system_mcp_my-mcp-server
Ran get_computer_system in my-mcp-server
<>
What am I missing?
Thank you much!
Cheers,
GM
All reactions