Skip to content

Java: .Net: New Feature: rate limit metadata #8421

@mku-wedoai

Description

@mku-wedoai

Raw Azure OpenAi chat completion response contains additional headers, which contain information about rate limits:
x-rate-limit-remaining-requests and x-ratelimit-remaining-tokens. Would it be possible to add these values to the Metadata dictionary in both OpenAIStreamingChatMessageContent and OpenAIChatMessageContent class? I find rate limit information useful, but in current .Net implementation there is no way to access it.

Metadata

Metadata

Labels

.NETIssue or Pull requests regarding .NET codeai connectorAnything related to AI connectorsjavaIssue or PR regarding Java codepythonPull requests for the Python Semantic KernelstaleIssue is stale because it has been open for a while and has no activity

Type

No type
No fields configured for issues without a type.

Projects

Status
Backlog: Planned

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions