Skip to content

OpenAI: Response API Conversation Memory #279

@AkhileshNegi

Description

@AkhileshNegi

Is your feature request related to a problem? Please describe.
We have recently integrated OpenAI response API in AI Platform but to retain conversation memory there is a slight twist as opposed to threads API
According to the docs here:
https://platform.openai.com/docs/guides/conversation-state?api-mode=responses#openai-apis-for-conversation-state

If we extend the code to send a third message, we’re supposed to pass the response_id from the second_response. But this response_id is different from the response_id from first_response — it has the same prefix and suffix, but the middle part changes.

This seems quite different from the Threads API, where one can keep the same thread_id for the whole conversation, even though each message has its own message_id.

Describe the solution you'd like
While this is raised to OpenAI team, we'll need a temporary solution meanwhile in AI Platform to retain conversation memory through single ID as we are planning to migrate Glific

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

Status

Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions