Skip to content

Conversation

dlarocque
Copy link
Contributor

Adds a startVideoRecording helper function which captures media input from either the user's camera or screen and sends it to the Live model using sendVideoRealtime.

This makes it easy for developers to add video recording functionality, without having to make considerations for things like base64-encoding, using browser APIs, and breaking up the video input to 1 FPS frames.

Draft- missing API approval and tests.

Copy link

changeset-bot bot commented Oct 17, 2025

⚠️ No Changeset found

Latest commit: c7f67b7

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Copy link
Contributor

Vertex AI Mock Responses Check ⚠️

A newer major version of the mock responses for Vertex AI unit tests is available. update_vertexai_responses.sh should be updated to clone the latest version of the responses: v15.0

Adds a `startVideoRecording` helper function which captures media input
from either the user's camera or screen and sends it to the Live model
using `sendVideoRealtime`.

This makes it easy for developers to add video recording functionality,
without having to make considerations for things like base64-encoding,
using browser APIs, and breaking up the video input to 1 FPS frames.
@google-oss-bot
Copy link
Contributor

google-oss-bot commented Oct 17, 2025

Size Report 1

Affected Products

  • @firebase/ai

    TypeBase (217cc4c)Merge (4c92e79)Diff
    browser64.0 kB66.8 kB+2.73 kB (+4.3%)
    main67.8 kB70.6 kB+2.83 kB (+4.2%)
    module64.0 kB66.8 kB+2.73 kB (+4.3%)
  • firebase

    TypeBase (217cc4c)Merge (4c92e79)Diff
    firebase-ai.js50.6 kB52.8 kB+2.22 kB (+4.4%)

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/fFMxsSkmPP.html

@google-oss-bot
Copy link
Contributor

google-oss-bot commented Oct 17, 2025

Size Analysis Report 1

Affected Products

  • @firebase/ai

    • LiveGenerativeModel

      Size

      TypeBase (217cc4c)Merge (4c92e79)Diff
      size13.5 kB13.5 kB+28 B (+0.2%)
      size-with-ext-deps31.2 kB31.2 kB+28 B (+0.1%)
    • LiveSession

      Size

      TypeBase (217cc4c)Merge (4c92e79)Diff
      size9.93 kB9.96 kB+28 B (+0.3%)
      size-with-ext-deps27.5 kB27.6 kB+28 B (+0.1%)
    • getLiveGenerativeModel

      Size

      TypeBase (217cc4c)Merge (4c92e79)Diff
      size16.0 kB16.0 kB+28 B (+0.2%)
      size-with-ext-deps33.7 kB33.7 kB+28 B (+0.1%)
    • startAudioConversation

      Size

      TypeBase (217cc4c)Merge (4c92e79)Diff
      size12.7 kB12.7 kB+75 B (+0.6%)
      size-with-ext-deps30.5 kB30.6 kB+75 B (+0.2%)
    • startVideoRecording

      Size

      TypeBase (217cc4c)Merge (4c92e79)Diff
      size?8.68 kB? (?)
      size-with-ext-deps?26.3 kB? (?)

      Dependency

      TypeBase (217cc4c)Merge (4c92e79)Diff
      functions?

      chromeAdapterFactory
      decodeInstanceIdentifier
      factory
      registerAI
      startVideoRecording

      ?
      classes?

      AIError
      AIService
      Backend
      ChromeAdapterImpl
      GoogleAIBackend
      VertexAIBackend
      VideoRecordingRunner

      ?
      variables?

      11 dependencies

      AIErrorCode
      AI_TYPE
      Availability
      BackendType
      DEFAULT_LOCATION
      InferenceMode
      Task
      VIDEO_FRAME_RATE
      logger
      name
      version

      ?
      enums??

      External Dependency

      ModuleBase (217cc4c)Merge (4c92e79)Diff
      @firebase/app?

      _registerComponent
      registerVersion

      ?
      @firebase/component?

      Component

      ?
      @firebase/logger?

      Logger

      ?
      @firebase/util?

      FirebaseError

      ?

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/C8Iqusjew2.html

Base automatically changed from dl/live-send to main October 20, 2025 16:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants