Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement Gemini Vision #551

Closed
abrichr opened this issue Dec 18, 2023 · 1 comment
Closed

Implement Gemini Vision #551

abrichr opened this issue Dec 18, 2023 · 1 comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@abrichr
Copy link
Member

abrichr commented Dec 18, 2023

Feature request

We would like to implement Gemini 1.5 and/or Gemini Vision in openadapt.adapters.gemini.

Related: #565

Gemini 1.5: https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/#sundar-note

Gemini Vision: image

Motivation

https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/#sundar-note

1 million tokens

https://www.linkedin.com/feed/update/urn:li:activity:7140972956314247168/

Gemini Pro Vision (multimodal) works good and is available to everyone! I did a quick test and the results I got were similar to GPT4-Vision.
Descriptions are accurate. Colors, and directions of objects are correct! Something Llava did not get right, unfortunately ...
⚡The good thing is you can use Gemini Pro already today, at 1 𝐫𝐞𝐪𝐮𝐞𝐬𝐭 𝐩𝐞𝐫 𝐬𝐞𝐜𝐨𝐧𝐝 compared to 100 requests per day for GPT-4 vision.
Google has enough GPUs to serve the world apparently 😏

@abrichr abrichr added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed labels Dec 18, 2023
@abrichr
Copy link
Member Author

abrichr commented Apr 16, 2024

Implemented in #610

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant