Groq fails to return the output

[harshinharshi]

Checked other resources

• This is a bug, not a usage question. For questions, please use the LangChain Forum (https://forum.langchain.com/).
• I added a clear and descriptive title that summarizes this issue.
• I used the GitHub search to find a similar question and didn't find it.
• I am sure that this is a bug in LangChain rather than my code.
• The bug is not resolved by updating to the latest stable version of LangChain (or the specific integration package).
• I read what a minimal reproducible example is (https://stackoverflow.com/help/minimal-reproducible-example).
• I posted a self-contained, minimal, reproducible example. A maintainer can copy it and run it AS IS.

Example Code

test.ipynb

Error Message and Stack Trace (if applicable)

---

TypeError Traceback (most recent call last)
Cell In[11], line 19
3 llm = ChatGroq(
4 model="deepseek-r1-distill-llama-70b",
5 temperature=0,
(...)
10 # other params...
11 )
12 messages = [
13 (
14 "system",
(...)
17 ("human", "I love programming."),
18 ]
---> 19 ai_msg = llm.invoke(messages)
20 ai_msg

File c:\Project\Teaching_AI_agents.venv\Lib\site-packages\langchain_core\language_models\chat_models.py:383, in BaseChatModel.invoke(self, input, config, stop, **kwargs)
371 OverRide
372 def invoke(
373 self,
(...)
378 **kwargs: Any,
379 ) -> BaseMessage:
380 config = ensure_config(config)
381 return cast(
382 "ChatGeneration",
--> 383 self.generate_prompt(
384 [self._convert_input(input)],
385 stop=stop,
386 callbacks=config.get("callbacks"),
387 tags=config.get("tags"),
388 metadata=config.get("metadata"),
389 run_name=config.get("run_name"),
390 run_id=config.pop("run_id", None),
391 **kwargs,
392 ).generations[0][0],
393 ).message

File c:\Project\Teaching_AI_agents.venv\Lib\site-packages\langchain_core\language_models\chat_models.py:1006, in BaseChatModel.generate_prompt(self, prompts, stop, callbacks, **kwargs)
997 OverRide
998 def generate_prompt(
999 self,
(...)
1003 **kwargs: Any,
1004 ) -> LLMResult:
1005 prompt_messages = [p.to_messages() for p in prompts]
-> 1006 return self.generate(prompt_messages, stop=stop, callbacks=callbacks, **kwargs)

File c:\Project\Teaching_AI_agents.venv\Lib\site-packages\langchain_core\language_models\chat_models.py:825, in BaseChatModel.generate(self, messages, stop, callbacks, tags, metadata, run_name, run_id, **kwargs)
822 for i, m in enumerate(input_messages):
823 try:
824 results.append(
--> 825 self._generate_with_cache(
826 m,
827 stop=stop,
828 run_manager=run_managers[i] if run_managers else None,
829 **kwargs,
830 )
831 )
832 except BaseException as e:
833 if run_managers:

File c:\Project\Teaching_AI_agents.venv\Lib\site-packages\langchain_core\language_models\chat_models.py:1072, in BaseChatModel._generate_with_cache(self, messages, stop, run_manager, **kwargs)
1070 result = generate_from_stream(iter(chunks))
1071 elif inspect.signature(self._generate).parameters.get("run_manager"):
-> 1072 result = self._generate(
1073 messages, stop=stop, run_manager=run_manager, **kwargs
1074 )
1075 else:
1076 result = self._generate(messages, stop=stop, **kwargs)

File c:\Project\Teaching_AI_agents.venv\Lib\site-packages\langchain_groq\chat_models.py:504, in ChatGroq._generate(self, messages, stop, run_manager, **kwargs)
499 message_dicts, params = self._create_message_dicts(messages, stop)
500 params = {
501 **params,
502 **kwargs,
503 }
--> 504 response = self.client.create(messages=message_dicts, **params)
505 return self._create_chat_result(response)

TypeError: Completions.create() got an unexpected keyword argument 'reasoning_format'

Description

I attempted to call LangChain using the Groq integration with the following import:

from langchain_groq import ChatGroq

When trying to use the openai/gpt-oss-120b model, the code returned the error mentioned above. However, when I used the same model directly from Groq, it worked as expected.

Could someone please look into this?

System Info

System Information

OS: Windows
OS Version: 10.0.22631
Python Version: 3.11.9 (tags/v3.11.9:de54cf5, Apr 2 2024, 10:12:12) [MSC v.1938 64 bit (AMD64)]

Package Information

langchain_core: 0.3.74
langchain: 0.3.27
langchain_community: 0.3.27
langsmith: 0.4.13
langchain_groq: 0.3.3
langchain_openai: 0.3.29
langchain_text_splitters: 0.3.9
langgraph_api: 0.2.128
langgraph_cli: 0.3.6
langgraph_license: Installed. No version info available.
langgraph_runtime: Installed. No version info available.
langgraph_runtime_inmem: 0.6.11
langgraph_sdk: 0.2.4

Optional packages not installed

langserve

Other Dependencies

aiohttp<4.0.0,>=3.8.3: Installed. No version info available.
async-timeout<5.0.0,>=4.0.0;: Installed. No version info available.
blockbuster<2.0.0,>=1.5.24: Installed. No version info available.
click>=8.1.7: Installed. No version info available.
cloudpickle>=3.0.0: Installed. No version info available.
cryptography<45.0,>=42.0.0: Installed. No version info available.
dataclasses-json<0.7,>=0.5.7: Installed. No version info available.
groq<1,>=0.4.1: Installed. No version info available.
httpx-sse<1.0.0,>=0.4.0: Installed. No version info available.
httpx<1,>=0.23.0: Installed. No version info available.
httpx>=0.25.0: Installed. No version info available.
httpx>=0.25.2: Installed. No version info available.
jsonpatch<2.0,>=1.33: Installed. No version info available.
jsonschema-rs<0.30,>=0.20.0: Installed. No version info available.
langchain-anthropic;: Installed. No version info available.
langchain-aws;: Installed. No version info available.
langchain-azure-ai;: Installed. No version info available.
langchain-cohere;: Installed. No version info available.
langchain-community;: Installed. No version info available.
langchain-core<1.0.0,>=0.3.66: Installed. No version info available.
langchain-core<1.0.0,>=0.3.72: Installed. No version info available.
langchain-core<1.0.0,>=0.3.74: Installed. No version info available.
langchain-core>=0.3.64: Installed. No version info available.
langchain-deepseek;: Installed. No version info available.
langchain-fireworks;: Installed. No version info available.
langchain-google-genai;: Installed. No version info available.
langchain-google-vertexai;: Installed. No version info available.
langchain-groq;: Installed. No version info available.
langchain-huggingface;: Installed. No version info available.
langchain-mistralai;: Installed. No version info available.
langchain-ollama;: Installed. No version info available.
langchain-openai;: Installed. No version info available.
langchain-perplexity;: Installed. No version info available.
langchain-text-splitters<1.0.0,>=0.3.9: Installed. No version info available.
langchain-together;: Installed. No version info available.
langchain-xai;: Installed. No version info available.
langchain<1.0.0,>=0.3.26: Installed. No version info available.
langgraph-api<0.3.0,>=0.2.67;: Installed. No version info available.
langgraph-checkpoint>=2.0.23: Installed. No version info available.
langgraph-checkpoint>=2.0.25: Installed. No version info available.
langgraph-runtime-inmem<0.7,>=0.6.9: Installed. No version info available.
langgraph-runtime-inmem>=0.6.0;: Installed. No version info available.
langgraph-sdk>=0.1.0;: Installed. No version info available.
langgraph-sdk>=0.2.0: Installed. No version info available.
langgraph>=0.2: Installed. No version info available.
langgraph>=0.4.0: Installed. No version info available.
langsmith-pyo3>=0.1.0rc2;: Installed. No version info available.
langsmith>=0.1.125: Installed. No version info available.
langsmith>=0.1.17: Installed. No version info available.
langsmith>=0.3.45: Installed. No version info available.
numpy>=1.26.2;: Installed. No version info available.
numpy>=2.1.0;: Installed. No version info available.
openai-agents>=0.0.3;: Installed. No version info available.
openai<2.0.0,>=1.86.0: Installed. No version info available.
opentelemetry-api>=1.30.0;: Installed. No version info available.
opentelemetry-exporter-otlp-proto-http>=1.30.0;: Installed. No version info available.
opentelemetry-sdk>=1.30.0;: Installed. No version info available.
orjson>=3.10.1: Installed. No version info available.
orjson>=3.9.14;: Installed. No version info available.
orjson>=3.9.7: Installed. No version info available.
packaging>=23.2: Installed. No version info available.
pydantic-settings<3.0.0,>=2.4.0: Installed. No version info available.
pydantic<3,>=1: Installed. No version info available.
pydantic<3.0.0,>=2.7.4: Installed. No version info available.
pydantic>=2.7.4: Installed. No version info available.
pyjwt>=2.9.0: Installed. No version info available.
pytest>=7.0.0;: Installed. No version info available.
python-dotenv>=0.8.0;: Installed. No version info available.
PyYAML>=5.3: Installed. No version info available.
requests-toolbelt>=1.0.0: Installed. No version info available.
requests<3,>=2: Installed. No version info available.
requests>=2.0.0: Installed. No version info available.
rich>=13.9.4;: Installed. No version info available.
SQLAlchemy<3,>=1.4: Installed. No version info available.
sse-starlette<2.2.0,>=2.1.0: Installed. No version info available.
sse-starlette>=2: Installed. No version info available.
starlette>=0.37: Installed. No version info available.
starlette>=0.38.6: Installed. No version info available.
structlog<26,>=24.1.0: Installed. No version info available.
structlog>23: Installed. No version info available.
tenacity!=8.4.0,<10,>=8.1.0: Installed. No version info available.
tenacity!=8.4.0,<10.0.0,>=8.1.0: Installed. No version info available.
tenacity>=8.0.0: Installed. No version info available.
tiktoken<1,>=0.7: Installed. No version info available.
truststore>=0.1: Installed. No version info available.
typing-extensions>=4.7: Installed. No version info available.
uvicorn>=0.26.0: Installed. No version info available.
vcrpy>=7.0.0;: Installed. No version info available.
watchfiles>=0.13: Installed. No version info available.
zstandard>=0.23.0: Installed. No version info available.

[keenborder786]

Upgrade to latest version of ChatGroq and the problem should be fixed.

[starchou6]

Hi! I'm wondering if this bug has been resolved yet?
I believe that even after upgrading ChatGroq to the latest version, there might still be issues because it seems like there's a TypeError problem with the reasoning_format parameter.
From what I can see, the issue is that LangChain is passing reasoning_format=None to the Groq API, but the Groq client doesn't accept None values for this parameter - it expects the parameter to be omitted entirely when not set.

[harshinharshi]

Upgrade to latest version of ChatGroq and the problem should be fixed.

its working thank you

[harshinharshi]

it's resolved thank you

[mdrxy]

Zhou Jing (@starchou6) would you mind sending a snippet of code to reproduce the issue you're running into?

[starchou6]

@starchou6 would you mind sending a snippet of code to reproduce the issue you're running into?

Sorry, I was worng.It looks good.