Skip to content

test(mcp): de-flake webkit dashboard CLI tests#41649

Merged
yury-s merged 1 commit into
microsoft:mainfrom
yury-s:fix-flaky-mcp-webkit-cli-tests
Jul 6, 2026
Merged

test(mcp): de-flake webkit dashboard CLI tests#41649
yury-s merged 1 commit into
microsoft:mainfrom
yury-s:fix-flaky-mcp-webkit-cli-tests

Conversation

@yury-s

@yury-s yury-s commented Jul 6, 2026

Copy link
Copy Markdown
Member

Summary

  • annotate.spec.ts "should capture annotations via show --annotate" hit the 30s test timeout inside connectToDashboard's unbounded toPass on slow webkit startup — mark it test.slow(), matching the sibling dashboard tests in the file.
  • cli-killall.spec.ts "kill-all kills filtered dashboard pid" observed a live daemon 1ms before kill-all, yet kill-all reported "No daemon processes found". Its discovery is best-effort (ps auxww via execSync, failures swallowed), so retry until it observes and kills the daemon.

Both surfaced as flakes on the macos-latest - webkit MCP shard.

Two MCP CLI tests flaked on the webkit CI shard:

- annotate.spec.ts "should capture annotations via show --annotate" hit
  the 30s test timeout inside connectToDashboard's unbounded toPass on
  slow webkit startup. Mark it test.slow(), matching the sibling
  dashboard tests in the file.
- cli-killall.spec.ts "kill-all kills filtered dashboard pid" observed a
  live daemon 1ms before kill-all, yet kill-all reported "No daemon
  processes found". kill-all discovery is best-effort (ps auxww via
  execSync, failures swallowed), so retry until it observes and kills it.
});
expect(output).toContain(`Killed daemon process ${dashboardPid}`);
expect(output).toContain('Killed 1 daemon process.');
// kill-all discovers daemons via `execSync('ps auxww')` and treats any failure

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not confident that it is what actually happens, but it is worth trying.

@yury-s yury-s requested a review from pavelfeldman July 6, 2026 21:21
@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

Test results for "MCP"

7643 passed, 1132 skipped


Merge workflow run.

@yury-s yury-s merged commit d6bc3ac into microsoft:main Jul 6, 2026
17 checks passed
@yury-s yury-s deleted the fix-flaky-mcp-webkit-cli-tests branch July 6, 2026 23:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants