Skip to content

Conversation

@ammar-agent
Copy link
Collaborator

Generated with mux

Fixes flaky integration tests observed in PR #701.

Changes:

  • Runtime Bash Test: Decoupled tool execution time verification from total test duration. Now measures strict execution time (<10s) using event timestamps, while allowing a generous overall timeout (30s) to accommodate CI network/AI latency.
  • Web Search Test: Lowered thinkingLevel to 'low' to improve speed and reliability, and increased timeout to 180s.

Verification:

  • tests/ipcMain/runtimeExecuteBash.test.ts passes locally.
  • tests/ipcMain/openai-web-search.test.ts passes locally.

- Decouple bash tool execution duration from network/AI latency
- Use event timestamps to measure strict tool performance (<10s)
- Relax overall test timeouts to prevent CI failures on slow runners
- Lower reasoning effort for web_search test to improve speed
@ammar-agent ammar-agent force-pushed the fix/flaky-tests-pr701 branch from 6a5d968 to e396aac Compare November 24, 2025 02:21
@ammario ammario merged commit 5f31123 into main Nov 24, 2025
13 checks passed
@ammario ammario deleted the fix/flaky-tests-pr701 branch November 24, 2025 02:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants