Skip to content

feat(web): add per-model temperature configuration#1103

Merged
brendan-kellam merged 3 commits intomainfrom
brendan/add-per-model-temperature
Apr 9, 2026
Merged

feat(web): add per-model temperature configuration#1103
brendan-kellam merged 3 commits intomainfrom
brendan/add-per-model-temperature

Conversation

@brendan-kellam
Copy link
Copy Markdown
Contributor

@brendan-kellam brendan-kellam commented Apr 9, 2026

Summary

  • Adds an optional temperature field to all 12 language model provider schemas, allowing temperature to be set per model
  • Per-model temperature takes precedence over the SOURCEBOT_CHAT_MODEL_TEMPERATURE env var, which is now deprecated and defaults to undefined
  • Threads temperature through getAISDKLanguageModelAndOptionscreateMessageStreamcreateAgentStreamstreamText

🤖 Generated with Claude Code

Summary by CodeRabbit

  • New Features

    • Added optional per-model temperature configuration for all supported language model providers, enabling granular control of model behavior.
  • Changed

    • The SOURCEBOT_CHAT_MODEL_TEMPERATURE environment variable is deprecated. Use per-model temperature configuration instead. When not configured, temperature defaults to API provider settings.

Adds an optional `temperature` field to all language model provider
schemas, allowing temperature to be configured per model instead of
globally via environment variable. The per-model setting takes
precedence, with the env var as a fallback.

Also deprecates SOURCEBOT_CHAT_MODEL_TEMPERATURE (now defaults to
undefined instead of 0.3) in favor of the per-model config.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@github-actions

This comment has been minimized.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai bot commented Apr 9, 2026

Caution

Review failed

Pull request was closed or merged during review

Walkthrough

This PR adds a per-model temperature configuration option for all language model providers across the codebase. The global SOURCEBOT_CHAT_MODEL_TEMPERATURE environment variable is deprecated and changed to not provide a default value. Temperature settings are now threaded through the chat streaming pipeline from model configuration.

Changes

Cohort / File(s) Summary
Schema & Documentation
CHANGELOG.md, docs/snippets/schemas/v3/index.schema.mdx, docs/snippets/schemas/v3/languageModel.schema.mdx
Added changelog entries documenting the new per-model temperature configuration option and deprecation of SOURCEBOT_CHAT_MODEL_TEMPERATURE default fallback. Updated documentation schemas with the new field.
Schema Type Definitions
packages/schemas/src/v3/index.type.ts, packages/schemas/src/v3/languageModel.type.ts
Added optional temperature?: number property to 12 language model provider interfaces (AmazonBedrock, Anthropic, Azure, DeepSeek, GoogleGenerativeAI, GoogleVertex*, Mistral, OpenAI, OpenAICompatible, OpenRouter, Xai).
Schema Implementations
packages/schemas/src/v3/index.schema.ts, packages/schemas/src/v3/languageModel.schema.ts, schemas/v3/languageModel.json
Added optional temperature numeric property (with description "Optional temperature setting to use with the model.") to all 12 provider-specific model configuration schemas across schema definitions and oneOf branches.
Environment Configuration Deprecation
packages/shared/src/env.server.ts
Changed SOURCEBOT_CHAT_MODEL_TEMPERATURE from numberSchema.default(0.3) to numberSchema.optional() with JSDoc deprecation notice directing users to per-model temperature configuration.
Chat Pipeline Integration
packages/web/src/app/api/(server)/chat/route.ts, packages/web/src/features/chat/utils.server.ts, packages/web/src/features/chat/agent.ts, packages/web/src/features/mcp/askCodebase.ts
Updated getAISDKLanguageModelAndOptions to extract and return temperature from model config. Threaded temperature as modelTemperature through createMessageStream and createAgentStream to the streamText invocation, allowing per-model temperature override of environment variable fallback.

Sequence Diagram

sequenceDiagram
    participant RouteHandler as Route Handler
    participant UtilsServer as getAISDKLanguageModelAndOptions
    participant Agent as createMessageStream/Agent
    participant StreamText as streamText (AI SDK)

    RouteHandler->>UtilsServer: getAISDKLanguageModelAndOptions(languageModelConfig)
    UtilsServer-->>RouteHandler: { model, providerOptions, temperature }
    RouteHandler->>Agent: createMessageStream({ model, modelTemperature: temperature, ... })
    Agent->>StreamText: streamText({ ..., temperature: temperature ?? env.SOURCEBOT_CHAT_MODEL_TEMPERATURE })
    StreamText-->>Agent: stream response
    Agent-->>RouteHandler: message stream
Loading

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Possibly related PRs

  • PR #1101: Also modifies getAISDKLanguageModelAndOptions to return additional per-model/provider options (adds reasoningEffort alongside the temperature added here).
  • PR #424: Introduces the openai-compatible provider (schema, types, and handler logic), which is now extended with per-model temperature support in this PR.
  • PR #976: Modifies the same chat stack functions (getAISDKLanguageModelAndOptions, createMessageStream in agent.ts) that are updated here for temperature threading.

Suggested reviewers

  • msukkari
  • Ferexx
🚥 Pre-merge checks | ✅ 3
✅ Passed checks (3 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title 'feat(web): add per-model temperature configuration' accurately and concisely summarizes the main change: introducing a new per-model temperature configuration feature across language model providers.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch brendan/add-per-model-temperature

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@mintlify
Copy link
Copy Markdown

mintlify bot commented Apr 9, 2026

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
sourcebot 🟢 Ready View Preview Apr 9, 2026, 6:31 PM

💡 Tip: Enable Workflows to automatically generate PRs for you.

…ation

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@brendan-kellam brendan-kellam merged commit 49591a0 into main Apr 9, 2026
8 of 9 checks passed
@brendan-kellam brendan-kellam deleted the brendan/add-per-model-temperature branch April 9, 2026 18:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant