Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE REQ] Expose API responses object model's custom deserialization #43657

Closed
origine999 opened this issue Apr 25, 2024 · 2 comments
Closed
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team.

Comments

@origine999
Copy link

Library name

Azure.AI.OpenAI

Please describe the feature.

Azure.AI.OpenAI has custom code for deserializing the REST API's responses (for instance completions, chat completions).

For instance: internal static Completions DeserializeCompletions(JsonElement element, ModelReaderWriterOptions options = null)

The problem is that if I get a REST API response from another mean (let's say through a proxy LLM API), it's not possible to leverage this library's object model for completions.

Solution would be to expose this custom deserialization logic to allow converting a string response to Azure.AI.OpenAI's object model.

Note: another benefit of this is let's say you have a CSV storing thousands of OpenAI API responses, you could load it up in a C# program and rehydrate those using the object model.

@github-actions github-actions bot added Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team. labels Apr 25, 2024
Copy link

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @jpalvarezl @trrwilson.

@origine999
Copy link
Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention This issue is responsible by Azure service team.
Projects
None yet
Development

No branches or pull requests

1 participant