Skip to content

test: skip agent e2e when LLM budget is exhausted#445

Merged
ling-senpeng13 merged 1 commit into
mainfrom
fix/agent-e2e-llm-budget
Jul 23, 2026
Merged

test: skip agent e2e when LLM budget is exhausted#445
ling-senpeng13 merged 1 commit into
mainfrom
fix/agent-e2e-llm-budget

Conversation

@ling-senpeng13

Copy link
Copy Markdown
Contributor

Summary

  • skip the Anthropic-backed workflow judge when the API reports its configured usage limit is exhausted
  • skip the Anthropic media counterfactual when the server-backed agent reports the same budget error
  • preserve failures for all other API and workflow errors

Validation

  • python -m compileall -q e2e/test_suite1_basic_validation.py e2e/test_suite25_media_input.py
  • targeted pytest collection for both affected tests
  • git diff --check

Failure context: https://github.com/conductor-oss/python-sdk/actions/runs/29977126793/job/89314998661#step:12:429

@ling-senpeng13 ling-senpeng13 self-assigned this Jul 23, 2026
@codecov

codecov Bot commented Jul 23, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
see 3 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@ling-senpeng13
ling-senpeng13 merged commit 15920ed into main Jul 23, 2026
7 checks passed
@ling-senpeng13
ling-senpeng13 deleted the fix/agent-e2e-llm-budget branch July 23, 2026 23:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants