Skip to content

Use cheapest model in e2e test#4

Merged
gjkim42 merged 1 commit intomainfrom
use-cheapest-model-in-e2e
Feb 5, 2026
Merged

Use cheapest model in e2e test#4
gjkim42 merged 1 commit intomainfrom
use-cheapest-model-in-e2e

Conversation

@gjkim42
Copy link
Collaborator

@gjkim42 gjkim42 commented Feb 5, 2026

Summary

  • Add model: haiku to the Task spec in the e2e test to use the cheapest available model instead of the default, reducing test costs

Test plan

  • make test passes
  • make test-e2e runs with haiku model (requires cluster + CLAUDE_CODE_OAUTH_TOKEN)

🤖 Generated with Claude Code

Add model: haiku to the Task spec in the e2e test to reduce costs
by using the cheapest available model instead of the default.
Copilot AI review requested due to automatic review settings February 5, 2026 08:35
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR modifies the e2e test to explicitly specify a cheaper Claude model ("haiku") instead of using the default model, with the goal of reducing test execution costs.

Changes:

  • Added model: haiku field to the Task specification in the e2e test

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

name: ` + taskName + `
spec:
type: claude-code
model: haiku
Copy link

Copilot AI Feb 5, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The model name "haiku" may not match the expected format for Claude Code models. Based on the README.md documentation (line 106) and integration test (test/integration/task_test.go:65), model identifiers should use the full format like "claude-sonnet-4-20250514" or similar versioned names. Using just "haiku" might not be recognized by the Claude Code CLI. Consider using a complete model identifier like "claude-3-5-haiku-20241022" or verifying that "haiku" is a valid short form accepted by the CLI.

Suggested change
model: haiku
model: claude-3-5-haiku-20241022

Copilot uses AI. Check for mistakes.
@gjkim42 gjkim42 merged commit 8c085be into main Feb 5, 2026
11 checks passed
@gjkim42 gjkim42 deleted the use-cheapest-model-in-e2e branch February 5, 2026 08:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants