Skip to content

test(integration): skip flaky 'should exit gracefully on second Ctrl+C' test#23731

Closed
galz10 wants to merge 1 commit intomainfrom
galzahavi/fix/disable-flaky-e2e-test
Closed

test(integration): skip flaky 'should exit gracefully on second Ctrl+C' test#23731
galz10 wants to merge 1 commit intomainfrom
galzahavi/fix/disable-flaky-e2e-test

Conversation

@galz10
Copy link
Copy Markdown
Collaborator

@galz10 galz10 commented Mar 25, 2026

Summary

This PR skips the should exit gracefully on second Ctrl+C integration test in ctrl-c-exit.test.ts. This test is currently flaky on macOS and is causing E2E test failures in CI.

Details

The test uses multiple ctrl-c signals which are proving to be unreliable specifically on the macOS environment in CI runs. It is disabled to unblock the main branch while a more robust solution is developed. Tagging @SandyTao520 for visibility as they were the last person to touch this file/test.

Related Issues

Related to #23733

How to Validate

Run the integration tests to confirm the test is skipped:
npm test -w @google/gemini-cli-core -- integration-tests/ctrl-c-exit.test.ts

Pre-Merge Checklist

  • Updated relevant documentation and README (if needed)
  • Added/updated tests (if needed)
  • Noted breaking changes (if any)
  • Validated on required platforms/methods:
    • MacOS
      • npm run
      • npx
      • Docker
      • Podman
      • Seatbelt
    • Windows
      • npm run
      • npx
      • Docker
    • Linux
      • npm run
      • npx
      • Docker

…C' test

This test is currently flaky on macOS and is causing E2E test failures in CI.
@galz10 galz10 requested a review from a team as a code owner March 25, 2026 00:07
@gemini-code-assist
Copy link
Copy Markdown
Contributor

Summary of Changes

Hello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request aims to improve the stability of the continuous integration pipeline by temporarily disabling a specific integration test. The test, which simulates multiple Ctrl+C signals, was found to be unreliable on macOS, leading to intermittent build failures. By skipping this test, the PR ensures that the main branch remains unblocked, allowing for continued development while a permanent fix is being investigated.

Highlights

  • Test Skipping: The integration test 'should exit gracefully on second Ctrl+C' in ctrl-c-exit.test.ts has been temporarily skipped.
  • Flakiness Resolution: This change addresses a known flakiness issue on macOS CI environments, which was causing E2E test failures.
  • Unblocking Main Branch: The test was disabled to unblock the main branch while a more robust solution for handling multiple Ctrl+C signals is developed.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request temporarily disables a flaky integration test (ctrl-c-exit.test.ts) by marking it as it.skip. The review suggests creating a follow-up issue to track the fix for the flakiness and adding a TODO comment referencing the issue number, in line with development conventions for managing technical debt and maintaining code quality.

afterEach(async () => await rig.cleanup());

it('should exit gracefully on second Ctrl+C', async () => {
it.skip('should exit gracefully on second Ctrl+C', async () => {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

While skipping a flaky test is a pragmatic short-term solution to unblock CI, it introduces technical debt and a gap in test coverage. To ensure this is addressed, please create a follow-up issue to track fixing the flakiness and add a TODO comment referencing the issue number. This aligns with development conventions to track work and maintain code quality, as mentioned in the style guide (lines 64-65).

  // TODO(#<issue-number>): This test is flaky on macOS and has been temporarily disabled. It should be re-enabled once the underlying issue is fixed.
  it.skip('should exit gracefully on second Ctrl+C', async () => {
References
  1. Development conventions to track work and maintain code quality. (link)

@github-actions
Copy link
Copy Markdown

Size Change: -4 B (0%)

Total Size: 26.3 MB

Filename Size Change
./bundle/chunk-23DI7L5V.js 0 B -3.4 kB (removed) 🏆
./bundle/chunk-RGAW74XF.js 0 B -14.6 MB (removed) 🏆
./bundle/chunk-XN6LIP7Z.js 0 B -3.64 MB (removed) 🏆
./bundle/core-V2XIMZSL.js 0 B -43.4 kB (removed) 🏆
./bundle/devtoolsService-UUX2LQ3U.js 0 B -27.7 kB (removed) 🏆
./bundle/gemini-O3YTTRVA.js 0 B -521 kB (removed) 🏆
./bundle/interactiveCli-R244XGXP.js 0 B -1.62 MB (removed) 🏆
./bundle/oauth2-provider-PTOK7KZE.js 0 B -9.16 kB (removed) 🏆
./bundle/chunk-OTGWWHJZ.js 3.64 MB +3.64 MB (new file) 🆕
./bundle/chunk-QJUMA6Y7.js 3.4 kB +3.4 kB (new file) 🆕
./bundle/chunk-Y3EX2FEF.js 14.6 MB +14.6 MB (new file) 🆕
./bundle/core-KGUTBBB5.js 43.4 kB +43.4 kB (new file) 🆕
./bundle/devtoolsService-4KYZVI7B.js 27.7 kB +27.7 kB (new file) 🆕
./bundle/gemini-QHUXCBFV.js 521 kB +521 kB (new file) 🆕
./bundle/interactiveCli-RDWXB4XA.js 1.62 MB +1.62 MB (new file) 🆕
./bundle/oauth2-provider-NEN2TTFL.js 9.16 kB +9.16 kB (new file) 🆕
ℹ️ View Unchanged
Filename Size Change
./bundle/chunk-34MYV7JD.js 2.45 kB 0 B
./bundle/chunk-5AUYMPVF.js 858 B 0 B
./bundle/chunk-664ZODQF.js 124 kB 0 B
./bundle/chunk-DAHVX5MI.js 206 kB 0 B
./bundle/chunk-IUUIT4SU.js 56.5 kB 0 B
./bundle/chunk-IV2KUFMZ.js 1.96 MB 0 B
./bundle/chunk-RJTRUG2J.js 39.8 kB 0 B
./bundle/cleanup-R4BVQ3OU.js 0 B -856 B (removed) 🏆
./bundle/devtools-36NN55EP.js 696 kB 0 B
./bundle/dist-T73EYRDX.js 356 B 0 B
./bundle/gemini.js 2.06 kB 0 B
./bundle/getMachineId-bsd-TXG52NKR.js 1.55 kB 0 B
./bundle/getMachineId-darwin-7OE4DDZ6.js 1.55 kB 0 B
./bundle/getMachineId-linux-SHIFKOOX.js 1.34 kB 0 B
./bundle/getMachineId-unsupported-5U5DOEYY.js 1.06 kB 0 B
./bundle/getMachineId-win-6KLLGOI4.js 1.72 kB 0 B
./bundle/memoryDiscovery-CXSTQXLK.js 922 B 0 B
./bundle/multipart-parser-KPBZEGQU.js 11.7 kB 0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/client/main.js 221 kB 0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/src/_client-assets.js 227 kB 0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/src/index.js 11.5 kB 0 B
./bundle/node_modules/@google/gemini-cli-devtools/dist/src/types.js 132 B 0 B
./bundle/sandbox-macos-permissive-open.sb 890 B 0 B
./bundle/sandbox-macos-permissive-proxied.sb 1.31 kB 0 B
./bundle/sandbox-macos-restrictive-open.sb 3.36 kB 0 B
./bundle/sandbox-macos-restrictive-proxied.sb 3.56 kB 0 B
./bundle/sandbox-macos-strict-open.sb 4.82 kB 0 B
./bundle/sandbox-macos-strict-proxied.sb 5.02 kB 0 B
./bundle/src-QVCVGIUX.js 47 kB 0 B
./bundle/tree-sitter-7U6MW5PS.js 274 kB 0 B
./bundle/tree-sitter-bash-34ZGLXVX.js 1.84 MB 0 B
./bundle/cleanup-MXM65QYP.js 856 B +856 B (new file) 🆕

compressed-size-action

@galz10 galz10 closed this Mar 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant