-
Notifications
You must be signed in to change notification settings - Fork 4.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(ai-proxy): google-gemini support #12948
base: master
Are you sure you want to change the base?
Conversation
7724fc8
to
4c9b05b
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
@@ -0,0 +1,9 @@ | |||
FROM kong:3.6.1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
please remove this file
end | ||
|
||
local events = ai_shared.frame_to_events(chunk) | ||
local events = ai_shared.frame_to_events(chunk, conf.model.provider == "gemini") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
local events = ai_shared.frame_to_events(chunk, conf.model.provider == "gemini") | |
local is_raw_json = conf.model.provider == "gemini" | |
local events = ai_shared.frame_to_events(chunk, is_raw_json ) |
|
||
-- some new LLMs return the JSON object-by-object, | ||
-- because that totally makes sense to parse?! | ||
if raw_json_mode then |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we need some unit tests for this if
Summary
Adds Google Gemini support to Kong AI Gateway.
Checklist
changelog/unreleased/kong
orskip-changelog
label added on PR if changelog is unnecessary. README.mdIssue reference
AG-27