Add Gemma 3 test.

[pytorchbot]

Summary: Also, let multimodal runner accept image/audio data as floats too

Differential Revision: D84001548

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14837

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 2 Cancelled Jobs, 3 Unrelated Failures

As of commit 19d2230 with merge base e0dda90 ():

NEW FAILURES - The following jobs have failed:

• Build Presets / apple (ios-simulator) / build (gh)
  /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/apple/ExecuTorchLLM/Exported/ExecuTorchLLMMultimodalRunner.mm:250:58: error: no matching constructor for initialization of 'llm::Audio'
• Build Presets / apple (ios) / build (gh)
  /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/apple/ExecuTorchLLM/Exported/ExecuTorchLLMMultimodalRunner.mm:250:58: error: no matching constructor for initialization of 'llm::Audio'
• Build Presets / apple (macos) / build (gh)
  /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/apple/ExecuTorchLLM/Exported/ExecuTorchLLMMultimodalRunner.mm:250:58: error: no matching constructor for initialization of 'llm::Audio'

CANCELLED JOBS - The following jobs were cancelled. Please retry:

• pull / unittest / macos / macos-job (gh)
  ##[error]The operation was canceled.
• pull / unittest-editable / macos / macos-job (gh)
  ##[error]The operation was canceled.

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• pull / test-llama-runner-linux-android / linux-job (gh) (detected as infra flaky with no log or failing log classifier)
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh) (detected as infra flaky with no log or failing log classifier)
• pull / test-samsung-models-linux / linux-job (gh) (detected as infra flaky with no log or failing log classifier)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[GregoryComer]

Rebasing to see if later picks resolve the build issue.

[GregoryComer]

@shoumikhin Do you have a recommendation to fix this build error? Thanks.

/Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/apple/ExecuTorchLLM/Exported/ExecuTorchLLMMultimodalRunner.mm:250:58: error: no matching constructor for initialization of 'llm::Audio'
          nativeInputs.emplace_back(llm::MultimodalInput(llm::Audio(
                                                         ^
In file included from /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/apple/ExecuTorchLLM/Exported/ExecuTorchLLMMultimodalRunner.mm:13:
In file included from /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/multimodal_runner.h:24:
In file included from /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/irunner.h:18:
In file included from /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/stats.h:11:
In file included from /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/util.h:11:
In file included from /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/multimodal_prefiller.h:15:
In file included from /Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/multimodal_input.h:14:
/Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/audio.h:35:24: note: candidate constructor (the implicit copy constructor) not viable: requires 1 argument, but 4 were provided
struct ET_EXPERIMENTAL Audio {
                       ^
/Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/audio.h:35:24: note: candidate constructor (the implicit move constructor) not viable: requires 1 argument, but 4 were provided
/Users/runner/work/executorch/executorch/pytorch/executorch/extension/llm/runner/audio.h:35:24: note: candidate constructor (the implicit default constructor) not viable: requires 0 arguments, but 4 were provided