Skip to content

[AI] Add configurable model generation for AI On-Device #8043

Merged
rlazo merged 21 commits intomainfrom
rl.select.model
Apr 29, 2026
Merged

[AI] Add configurable model generation for AI On-Device #8043
rlazo merged 21 commits intomainfrom
rl.select.model

Conversation

@rlazo
Copy link
Copy Markdown
Contributor

@rlazo rlazo commented Apr 16, 2026

Introduced GenerationConfig, ModelConfig, ModelReleaseStage, and ModelPreference to firebase-ai-ondevice-interop to allow for configurable model selection.

Updated the internal genaiPrompt dependency to 1.0.0-beta2 to support the new configuration options.

Deprecated the parameter-less FirebaseAIOnDeviceGenerativeModelFactory.newGenerativeModel() method in favor of a new overload that accepts a GenerationConfig.

rlazo added 5 commits April 16, 2026 10:17
Introduced `GenerationConfig`, `ModelConfig`, `ModelReleaseStage`, and
`ModelPreference` to `firebase-ai-ondevice-interop` to allow for
configurable model selection.

Updated the internal `genaiPrompt` dependency to `1.0.0-beta2` to support the new configuration options.

Deprecated the parameter-less
`FirebaseAIOnDeviceGenerativeModelFactory.newGenerativeModel()` method in favor of a new overload that accepts a `GenerationConfig`.
@gemini-code-assist
Copy link
Copy Markdown
Contributor

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

📝 PRs merging into main branch

Our main branch should always be in a releasable state. If you are working on a larger change, or if you don't want this change to see the light of the day just yet, consider using a feature branch first, and only merge into the main branch when the code complete and ready to be released.

@rlazo
Copy link
Copy Markdown
Contributor Author

rlazo commented Apr 17, 2026

/gemini review

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces configuration options for the on-device generative model by adding GenerationConfig and ModelConfig classes to the interop layer. It updates the FirebaseAIOnDeviceGenerativeModelFactory to support these configurations, deprecating the parameterless model creation method. Additionally, it includes converter functions to bridge interop and MLKit types and updates the genaiPrompt dependency version. Feedback was provided regarding incorrect ReplaceWith expressions in deprecation annotations and a minor inconsistency in KDoc documentation.

rlazo and others added 12 commits April 16, 2026 23:51
…le/firebase/ai/ondevice/interop/FirebaseAIOnDeviceGenerativeModelFactory.kt

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
…ase/ai/ondevice/FirebaseAIOnDeviceComponent.kt

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
…le/firebase/ai/ondevice/interop/FirebaseAIOnDeviceGenerativeModelFactory.kt

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
@rlazo
Copy link
Copy Markdown
Contributor Author

rlazo commented Apr 29, 2026

/gemini review

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces support for model selection and performance configuration (required for nano-v4) across the Firebase AI on-device modules. Key changes include the addition of GenerationConfig and ModelConfig in the interop layer, updates to the FirebaseAIOnDevice API to support these options during status checks and downloads, and integration into the high-level GenerativeModel configuration. Feedback focuses on reducing code duplication for the OnDeviceModelOption class, ensuring exhaustive when blocks for safety, implementing standard equals and hashCode methods for robustness, and utilizing Kotlin data classes to reduce boilerplate in configuration objects.

@google-oss-bot
Copy link
Copy Markdown
Collaborator

The public api surface has changed for the subproject ai-logic_firebase-ai-ondevice:
error: Removed method com.google.firebase.ai.ondevice.FirebaseAIOnDevice.checkStatus(kotlin.coroutines.Continuation<? super com.google.firebase.ai.ondevice.OnDeviceModelStatus>) [RemovedMethod]
error: Added method com.google.firebase.ai.ondevice.FirebaseAIOnDevice.checkStatus(com.google.firebase.ai.ondevice.OnDeviceModelOption,kotlin.coroutines.Continuation<? super com.google.firebase.ai.ondevice.OnDeviceModelStatus>) [AddedMethod]
error: Removed method com.google.firebase.ai.ondevice.FirebaseAIOnDevice.download() [RemovedMethod]
error: Added method com.google.firebase.ai.ondevice.FirebaseAIOnDevice.download(com.google.firebase.ai.ondevice.OnDeviceModelOption) [AddedMethod]
error: Added class com.google.firebase.ai.ondevice.OnDeviceModelOption [AddedClass]

The public api surface has changed for the subproject ai-logic_firebase-ai:
error: Added constructor com.google.firebase.ai.OnDeviceConfig(com.google.firebase.ai.InferenceMode,Integer,Float,Integer,Integer,int,com.google.firebase.ai.OnDeviceModelOption) [AddedMethod]
error: Added method com.google.firebase.ai.OnDeviceConfig.getModelOption() [AddedMethod]
error: Added class com.google.firebase.ai.OnDeviceModelOption [AddedClass]

Please update the api.txt files for the subprojects being affected by this change by running ./gradlew ${subproject}:generateApiTxtFile. Also perform a major/minor bump accordingly.

1 similar comment
@google-oss-bot
Copy link
Copy Markdown
Collaborator

The public api surface has changed for the subproject ai-logic_firebase-ai-ondevice:
error: Removed method com.google.firebase.ai.ondevice.FirebaseAIOnDevice.checkStatus(kotlin.coroutines.Continuation<? super com.google.firebase.ai.ondevice.OnDeviceModelStatus>) [RemovedMethod]
error: Added method com.google.firebase.ai.ondevice.FirebaseAIOnDevice.checkStatus(com.google.firebase.ai.ondevice.OnDeviceModelOption,kotlin.coroutines.Continuation<? super com.google.firebase.ai.ondevice.OnDeviceModelStatus>) [AddedMethod]
error: Removed method com.google.firebase.ai.ondevice.FirebaseAIOnDevice.download() [RemovedMethod]
error: Added method com.google.firebase.ai.ondevice.FirebaseAIOnDevice.download(com.google.firebase.ai.ondevice.OnDeviceModelOption) [AddedMethod]
error: Added class com.google.firebase.ai.ondevice.OnDeviceModelOption [AddedClass]

The public api surface has changed for the subproject ai-logic_firebase-ai:
error: Added constructor com.google.firebase.ai.OnDeviceConfig(com.google.firebase.ai.InferenceMode,Integer,Float,Integer,Integer,int,com.google.firebase.ai.OnDeviceModelOption) [AddedMethod]
error: Added method com.google.firebase.ai.OnDeviceConfig.getModelOption() [AddedMethod]
error: Added class com.google.firebase.ai.OnDeviceModelOption [AddedClass]

Please update the api.txt files for the subprojects being affected by this change by running ./gradlew ${subproject}:generateApiTxtFile. Also perform a major/minor bump accordingly.

@rlazo
Copy link
Copy Markdown
Contributor Author

rlazo commented Apr 29, 2026

Metalava check is complaining about major changes (public preview API) and minor (already a minor bump)

Safe to ignore

@rlazo rlazo marked this pull request as ready for review April 29, 2026 05:58
@rlazo rlazo requested a review from milaGGL April 29, 2026 05:58
milaGGL
milaGGL previously approved these changes Apr 29, 2026
Copy link
Copy Markdown
Contributor

@milaGGL milaGGL left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just some minor questions

Copy link
Copy Markdown
Contributor

@milaGGL milaGGL left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@rlazo rlazo enabled auto-merge (squash) April 29, 2026 14:23
@rlazo rlazo merged commit 25e26e0 into main Apr 29, 2026
316 of 328 checks passed
@rlazo rlazo deleted the rl.select.model branch April 29, 2026 14:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants