Python: Don't store AzureAIInferenceChatCompletion response inner_content inside of item's text content #10747
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation and Context
The
AzureAIInferenceChatCompletion
class, during_create_chat_message_content
creation, is storing theresponse
which is a non-hashable object. In other connectors, like theAzureChatCompletion
we do not store theresponse
in the CMC's TextContent item. Theresponse
is available as part of the mainChatMessageContent
that is returned, so we don't need to store this twice, especially since as part of agent group chat, we need to be able to get the inner item's hash for message comparison.Description
Remove the call to store the response as the item's inner_content here:
Contribution Checklist