Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Do not run flaky cli tests locally by default #15928

Merged
merged 1 commit into from Sep 5, 2023

Conversation

nicolo-ribaudo
Copy link
Member

@nicolo-ribaudo nicolo-ribaudo commented Sep 5, 2023

Q                       A
Fixed Issues? Fixes #1, Fixes #2
Patch: Bug Fix?
Major: Breaking Change?
Minor: New Feature?
Tests Added + Pass? Yes
Documentation PR Link
Any Dependency Changes?
License MIT

There is this very annoying test that fails whenever I run all the tests locally, but not if I run it individually. I'm not the only one affected by this: #14599 (comment)

We are trying to run Babel as part of Node.js' smoke tests suite (nodejs/citgm#628), and it triggers this error. Let's disable it by default, and only run it on CI. There is an env flag to run it locally.

@liuxingbaoyu
Copy link
Member

I remember it seems like after that we merged another PR to fix them.
Currently I can't reproduce these erratic tests, which is weird.

But it doesn’t matter, this PR is good for me.

@liuxingbaoyu
Copy link
Member

By the way, if there is anything I can do in citgm, please feel free to cc!
I just found out about it today. :)

@babel-bot
Copy link
Collaborator

Build successful! You can test your changes in the REPL here: https://babeljs.io/repl/build/55354/

Copy link
Contributor

@JLHwung JLHwung left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Meanwhile I will see how we can restructure this test and make it less flaky.

@nicolo-ribaudo nicolo-ribaudo merged commit ac766d6 into babel:main Sep 5, 2023
48 checks passed
@nicolo-ribaudo nicolo-ribaudo deleted the cli-flaky-test branch September 5, 2023 12:50
@github-actions github-actions bot added the outdated A closed issue/PR that is archived due to age. Recommended to make a new issue label Dec 6, 2023
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Dec 6, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area: tests outdated A closed issue/PR that is archived due to age. Recommended to make a new issue pkg: cli
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants