ChatOllama does not support bind_tools

[Harsh-Kesharwani]

Checked other resources

• I added a very descriptive title to this issue.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.
• I am sure that this is a bug in LangChain rather than my code.
• The bug is not resolved by updating to the latest stable version of LangChain (or the specific integration package).

Example Code

ChatOllama does not support bind_tools

Error Message and Stack Trace (if applicable)

No response

Description

ChatOllama does not support bind_tools

System Info

ChatOllama does not support bind_tools

[keenborder786]

You can use OllamaFunctions from langchain_experimental.llms.ollama_functions

[Harsh-Kesharwani]

@keenborder786 But i have to use function calling along with chat messages as open ai support in there API v1/completion.

[noshila]

nothing except for openai, mistral, google or others like that work. I tried with llama.cpp (original, python and server), ollama, kobold but now I am certain no opensource model or library works exactly like openai api.

[keenborder786]

I am afraid that is not possible because Function Calling is a special capability offered only by OpenAI

[keenborder786]

But you can always use tool calling by any llm using React agent.

[lalanikarim]

Take a look at #22339 which should have addressed this issue.
The PR was approved and merged yesterday but a release is yet to be cut from it and should happen in the next few days.

In the meantime, you may try and install langchain-experimental directly from langchain's source like this:

pip install git+https://github.com/langchain-ai/langchain.git\#egg=langchain-experimental\&subdirectory=libs/experimental

I hope this helps.