Feat Add headers to openai responses #506
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Codecov Report
@@ Coverage Diff @@
## master #506 +/- ##
==========================================
+ Coverage 97.48% 97.52% +0.04%
==========================================
Files 18 18
Lines 836 850 +14
==========================================
+ Hits 815 829 +14
Misses 15 15
Partials 6 6
|
|
Hey, thank you for the PR! Just out of curiosity: what use cases do you envision for this? |
|
The main motivation is because there are some issues related to headers However there is a documentation that covers headers for rate limits for example, and you may need these information. And, if you agree, the next PR could be focused to implement specifics methods of |
|
Thank you for the PR! Is there a way to get the header in steam mode? |
sashabaranov
approved these changes
Oct 9, 2023
mudler
pushed a commit
to mudler/LocalAI
that referenced
this pull request
Oct 14, 2023
…#1159) [](https://renovatebot.com) This PR contains the following updates: | Package | Type | Update | Change | |---|---|---|---| | [github.com/sashabaranov/go-openai](https://togithub.com/sashabaranov/go-openai) | require | minor | `v1.15.4` -> `v1.16.0` | --- ### Release Notes <details> <summary>sashabaranov/go-openai (github.com/sashabaranov/go-openai)</summary> ### [`v1.16.0`](https://togithub.com/sashabaranov/go-openai/releases/tag/v1.16.0) [Compare Source](https://togithub.com/sashabaranov/go-openai/compare/v1.15.4...v1.16.0) #### What's Changed - Add DotProduct Method and README Example for Embedding Similarity Search by [@​ealvar3z](https://togithub.com/ealvar3z) in [sashabaranov/go-openai#492 - fix: use any for n_epochs by [@​henomis](https://togithub.com/henomis) in [sashabaranov/go-openai#499 - Feat Add headers to openai responses by [@​henomis](https://togithub.com/henomis) in [sashabaranov/go-openai#506 - Support get http header and x-ratelimit-\* headers by [@​liushuangls](https://togithub.com/liushuangls) in [sashabaranov/go-openai#507 **Full Changelog**: sashabaranov/go-openai@v1.15.4...v1.16.0 </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate](https://www.mend.io/free-developer-tools/renovate/). View repository job log [here](https://developer.mend.io/github/go-skynet/LocalAI). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy44LjEiLCJ1cGRhdGVkSW5WZXIiOiIzNy44LjEiLCJ0YXJnZXRCcmFuY2giOiJtYXN0ZXIifQ==--> Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
mauriciovasquezbernal
added a commit
to mauriciovasquezbernal/go-openai
that referenced
this pull request
Dec 20, 2023
](https://renovatebot.com){kind=link}
Fixes issue when using non audio formats: Transcription error: json: cannot unmarshal number into Go value of type openai.audioTextResponse Fixes: 8e165dc ("Feat Add headers to openai responses (sashabaranov#506)")
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Describe the change
This branch adds headers to all opeanai http responses.
Describe your solution
This was done embedding a struct
httpHeaderto each response struct. ThehttpHeadertype has attached methods to set and gethttp.Header. The low levelsendRequestuses aResponseinterface defining theSetHeadermethod ofhttpHeader.Tests
TestChatCompletionsWithHeadershas been added to check a test header.