-
Notifications
You must be signed in to change notification settings - Fork 4.6k
Java: .Net: New Feature: rate limit metadata #8421
Copy link
Copy link
Closed
Labels
.NETIssue or Pull requests regarding .NET codeIssue or Pull requests regarding .NET codeai connectorAnything related to AI connectorsAnything related to AI connectorsjavaIssue or PR regarding Java codeIssue or PR regarding Java codepythonPull requests for the Python Semantic KernelPull requests for the Python Semantic KernelstaleIssue is stale because it has been open for a while and has no activityIssue is stale because it has been open for a while and has no activity
Metadata
Metadata
Assignees
Labels
.NETIssue or Pull requests regarding .NET codeIssue or Pull requests regarding .NET codeai connectorAnything related to AI connectorsAnything related to AI connectorsjavaIssue or PR regarding Java codeIssue or PR regarding Java codepythonPull requests for the Python Semantic KernelPull requests for the Python Semantic KernelstaleIssue is stale because it has been open for a while and has no activityIssue is stale because it has been open for a while and has no activity
Type
Fields
Give feedbackNo fields configured for issues without a type.
Projects
StatusShow more project fields
Backlog: Planned
Raw Azure OpenAi chat completion response contains additional headers, which contain information about rate limits:
x-rate-limit-remaining-requestsandx-ratelimit-remaining-tokens. Would it be possible to add these values to theMetadatadictionary in bothOpenAIStreamingChatMessageContentandOpenAIChatMessageContentclass? I find rate limit information useful, but in current .Net implementation there is no way to access it.