Skip to content

Update Cerebras models and default - #2193

Open
rosetta-livekit-bot[bot] wants to merge 1 commit into
mainfrom
port-cerebras-models-default
Open

Update Cerebras models and default#2193
rosetta-livekit-bot[bot] wants to merge 1 commit into
mainfrom
port-cerebras-models-default

Conversation

@rosetta-livekit-bot

@rosetta-livekit-bot rosetta-livekit-bot Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Update the Cerebras public model catalog to gpt-oss-120b, zai-glm-4.7, and gemma-4-31b.
  • Use gpt-oss-120b as the default for the dedicated Cerebras plugin and OpenAI-compatible adapter.
  • Update the existing Cerebras integration tests and add patch changesets for the two changed packages.

Port of livekit/agents#6593.

Validation

  • pnpm build passed for all 40 workspace packages.
  • pnpm --filter @livekit/agents-plugin-openai build passed.
  • pnpm --filter @livekit/agents-plugin-cerebras build passed after its OpenAI dependency was built.
  • Built-artifact runtime smoke check verified both Cerebras defaults resolve to gpt-oss-120b.
  • pnpm --filter @livekit/agents-plugin-cerebras lint passed.
  • pnpm test plugins/openai ran 101 tests: 99 passed and 2 skipped; two unrelated suites fail during setup because the checkout has an invalid/missing Silero ONNX asset and tts.test.ts constructs the existing realtime STT without its newly required VAD.
  • pnpm test plugins/cerebras is blocked at collection because CEREBRAS_API_KEY is unavailable in this environment.
  • pnpm lint is blocked by pre-existing Prettier errors in plugins/baseten, plugins/phonic, and plugins/mistralai; the OpenAI package also has existing formatting errors outside this diff.

No target infrastructure gaps were found.

Source diff coverage

Source diff coverage

  • Ported: livekit-plugins/livekit-plugins-cerebras/livekit/plugins/cerebras/models.py to plugins/cerebras/src/models.ts, replacing the model union with the same three-model catalog.
  • Adapted: livekit-plugins/livekit-plugins-cerebras/livekit/plugins/cerebras/llm.py to plugins/cerebras/src/llm.ts, applying the same default through the TypeScript options object.
  • Ported: livekit-plugins/livekit-plugins-openai/livekit/plugins/openai/models.py to plugins/openai/src/models.ts, mirroring the same model union.
  • Adapted: livekit-plugins/livekit-plugins-openai/livekit/plugins/openai/llm.py to plugins/openai/src/llm.ts, applying the same default through the camelCase withCerebras adapter.
  • Adapted: tests/test_plugin_cerebras.py to plugins/cerebras/src/llm.test.ts, updating the existing JS integration-test model constants and rationale so chat and tool calls both use gpt-oss-120b.
  • Not applicable: none; every source file has a target counterpart.

Ported from livekit/agents#6593

Original PR description

Summary

  • Adds zai-glm-4.7 and gemma-4-31b to both Cerebras model types and changes the dedicated plugin default to gpt-oss-120b.
  • The current public catalog is gpt-oss-120b, zai-glm-4.7, and gemma-4-31b.

Why

The previous model ID was retired or the fixed catalog was missing a currently available Cerebras model. This could produce failed requests, stale autocomplete, or misleading examples.

Validation

@rosetta-livekit-bot
rosetta-livekit-bot Bot requested a review from a team as a code owner July 31, 2026 19:25
@changeset-bot

changeset-bot Bot commented Jul 31, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0bf37e9

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 39 packages
Name Type
@livekit/agents-plugin-cerebras Patch
@livekit/agents-plugin-openai Patch
@livekit/agents-plugin-anam Patch
@livekit/agents-plugin-cartesia Patch
@livekit/agents-plugin-elevenlabs Patch
@livekit/agents-plugin-fishaudio Patch
@livekit/agents-plugin-google Patch
@livekit/agents-plugin-hume Patch
@livekit/agents-plugin-inworld Patch
@livekit/agents-plugin-krisp Patch
@livekit/agents-plugin-neuphonic Patch
@livekit/agents-plugin-perplexity Patch
@livekit/agents-plugin-rime Patch
@livekit/agents-plugin-sarvam Patch
@livekit/agents-plugin-xai Patch
@livekit/agents Patch
@livekit/agents-plugin-anthropic Patch
@livekit/agents-plugin-assemblyai Patch
@livekit/agents-plugin-azure Patch
@livekit/agents-plugin-baseten Patch
@livekit/agents-plugin-bey Patch
@livekit/agents-plugin-deepgram Patch
@livekit/agents-plugin-did Patch
@livekit/agents-plugin-hedra Patch
@livekit/agents-plugin-lemonslice Patch
@livekit/agents-plugin-liveavatar Patch
@livekit/agents-plugin-livekit Patch
@livekit/agents-plugin-minimax Patch
@livekit/agents-plugin-mistral Patch
@livekit/agents-plugin-mistralai Patch
@livekit/agents-plugin-phonic Patch
@livekit/agents-plugin-protoface Patch
@livekit/agents-plugin-resemble Patch
@livekit/agents-plugin-runway Patch
@livekit/agents-plugin-silero Patch
@livekit/agents-plugin-soniox Patch
@livekit/agents-plugin-tavus Patch
@livekit/agents-plugin-trugen Patch
@livekit/agents-plugins-test Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 1 additional finding.

Open in Devin Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants