[Bug]: Session ID is not properly set when using prev_response_id

[mojtabacazi]

What happened?

Docs states:

For the /responses endpoint, use previous_response_id to group requests into a session. The previous_response_id is returned in the response of each request.

https://docs.litellm.ai/docs/proxy/ui_logs_sessions#responses

I found that not to be true (or not working as expected). Setting the following works

    extra_body={
        "litellm_session_id": session_id  # Reuse the same session ID
    }

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.77

Twitter / LinkedIn details

No response

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.