Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Difference in results between Gemini via interface and package #90

Open
louisarthur opened this issue Feb 28, 2024 · 2 comments
Open

Difference in results between Gemini via interface and package #90

louisarthur opened this issue Feb 28, 2024 · 2 comments
Assignees
Labels
component:dart sdk Issue/PR related to Dart SDK status:triaged Issue/PR triaged to the corresponding sub-team type:bug Incorrect behavior (everything from a crash to more subtle misbehavior)

Comments

@louisarthur
Copy link

Hello everyone, I'm facing a problem in relation to using Gemini through the interface and the package, using default parameters to analyze an image and using the same prompt, I'm having a difference in the response. In the image detection package it is X and in Gemini through the interface it is Y. The interface always gets it right, the package gets it wrong.
Anyone else facing the same problem?

@singhniraj08 singhniraj08 added type:bug Incorrect behavior (everything from a crash to more subtle misbehavior) component:dart sdk Issue/PR related to Dart SDK status:triaged Issue/PR triaged to the corresponding sub-team and removed package:google_generative_ai labels Mar 7, 2024
@hortigado
Copy link

I am facing the same problem, the responses through the API are poor, sometimes it throws errors and many times you get an empty response.

@natebosch
Copy link
Collaborator

Gemini through the interface

Do you mean gemini.google.com or the mobile app? The Chat interface to gemini?
I don't think that is guaranteed to be backed by any specific model that you can access through the rest API.

the responses through the API are poor, sometimes it throws errors and many times you get an empty response.

These all look like questions that are best directed to the folks who maintain the model and the backend.

@singhniraj08 - this seems to be a question about the backend behavior. How do we typically route those issues? I don't have knowledge about the model behavior or the alternative interfaces to the LLM.

I don't see anything in this issue which is actionable in this repo.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:dart sdk Issue/PR related to Dart SDK status:triaged Issue/PR triaged to the corresponding sub-team type:bug Incorrect behavior (everything from a crash to more subtle misbehavior)
Projects
None yet
Development

No branches or pull requests

4 participants