Memory Condensation for 1p anthorpic. Error "extra_body: Extra inputs are not permitted"

[peteryongzhong]

It would appear that the condenser could be a little buggy. For 1p anthropic, it is giving the litellm extra body error. A simple repro is attached below:

import os

from openhands.sdk import LLM, Agent, Conversation, LLMSummarizingCondenser, Tool
from openhands.tools.file_editor import FileEditorTool
from openhands.tools.task_tracker import TaskTrackerTool


llm = LLM(
    model="anthropic/claude-sonnet-4-5-20250929",
    api_key="sk-ant....",
)
condenser = LLMSummarizingCondenser(
    llm=llm.model_copy(update={"usage_id": "condenser"}), max_size=10, keep_first=2
)

agent = Agent(
    llm=llm,
    tools=[
            # Tool(name=TerminalTool.name),
            Tool(name=FileEditorTool.name),
            Tool(name=TaskTrackerTool.name),
        ],
    condenser=condenser,
)

cwd = os.getcwd()
conversation = Conversation(agent=agent, workspace=cwd)

conversation.send_message("First create a status.txt and write `ping` and then continue polling the status.txt file until the content is `pong`")
conversation.run()
print("All done!")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/peterzhong/Desktop/openhands_test/example.py", line 30, in <module>
    conversation.run()
  File "/Users/peterzhong/Desktop/openhands_test/.venv/lib/python3.12/site-packages/lmnr/opentelemetry_lib/decorators/__init__.py", line 189, in wrap
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/Users/peterzhong/Desktop/openhands_test/.venv/lib/python3.12/site-packages/openhands/sdk/conversation/impl/local_conversation.py", line 337, in run
    raise ConversationRunError(self._state.id, e) from e
openhands.sdk.conversation.exceptions.ConversationRunError: Conversation run failed for id=c349ffbb-f1ed-4252-b142-149e89ff8e05: litellm.BadRequestError: AnthropicException - {"type":"error","error":{"type":"invalid_request_error","message":"extra_body: Extra inputs are not permitted"},"request_id":"req_011CVU4VRejG1PJm88BKpXgK"}
/Users/peterzhong/Desktop/openhands_test/.venv/lib/python3.12/site-packages/litellm/llms/custom_httpx/async_client_cleanup.py:66: DeprecationWarning: There is no current event loop
  loop = asyncio.get_event_loop()

[enyst]

Could you please tell, on what version and is it with the CLI? This was a bug in the recent past... 🤔

[peteryongzhong]

Latest version downloaded through pip for the repro. It is not the cli but the sdk itself. Fixable by commenting out the line in the condenser that added the extra body, but for models that do care about the extra body I am uncertain if this breaks some feature.

To repro I simply:

create a venv in python 3.12
install software agent sdk and the software agent sdk tools using pip
fill the api key
run the script against an empty folder

[enyst]

@OpenHands I don’t think the SDK should add any extra_body in the condenser LLM. Verify that the agent LLM doesn’t, and fix the condenser LLM to not do it either.

[openhands-ai]

I'm on it! enyst can track my progress at all-hands.dev

[openhands-ai]

Summary of work completed

Goal: Ensure the SDK does not add extra_body in the condenser LLM, and verify the agent LLM doesn’t do it either.

What I changed

• Removed explicit extra_body forwarding in the condenser:
  • openhands-sdk/openhands/sdk/context/condenser/llm_summarizing_condenser.py
  • Now calls llm.completion(messages=...) without extra_body; centralized options logic handles extra_body only if appropriate.
• Added a unit test to lock behavior:
  • tests/sdk/context/condenser/test_llm_summarizing_condenser.py::test_get_condensation_does_not_pass_extra_body
  • Asserts that the condenser does not pass extra_body to llm.completion.

Verification done

• Verified agent LLM path: Agent uses LLM.completion which normalizes kwargs via select_chat_options/select_responses_options; extra_body is only forwarded if llm.litellm_extra_body is set, and not forced by Agent code.
• Ran formatting/linting/type checks on modified files (pre-commit) — all passed.
• Ran condenser tests — 7 passed.
• Opened PR: Fix: Condenser LLM should not pass extra_body (Fixes #1252) #1266 (Fixes Memory Condensation for 1p anthorpic. Error "extra_body: Extra inputs are not permitted" #1252)

Checklist

• Verified agent LLM does not directly add extra_body: done
• Fixed condenser LLM to not add extra_body: done
• Changes are minimal and targeted: done
• Tests added for the new behavior and pass: done
• PR opened against main with clear description and “Fixes Memory Condensation for 1p anthorpic. Error "extra_body: Extra inputs are not permitted" #1252”: done

If you want, I can also add an integration test for a 1p Anthropic model path to ensure no provider rejection occurs end-to-end.

_{View full conversation}