Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pkg/dev_compiler/test/expression_compiler/expression_compiler_e2e_ddc_sound_test flaky -> Timeout #51740

Closed
alexmarkov opened this issue Mar 15, 2023 · 6 comments
Assignees
Labels
area-web Use area-web for Dart web related issues, including the DDC and dart2js compilers and JS interop. dev-compiler-test gardening P2 A bug or feature request we're likely to work on web-dev-compiler web-eval evaluation support on the web

Comments

@alexmarkov
Copy link
Contributor

There are new test failures on [dart2js] Remove test configs that are now unused.

The tests

pkg/dev_compiler/test/expression_compiler/expression_compiler_e2e_ddc_sound_test Timeout (expected Pass)

are failing on configurations

unittest-asserts-release-win

Log: https://dart-ci.appspot.com/log/pkg-win-release/unittest-asserts-release-win/24068/pkg/dev_compiler/test/expression_compiler/expression_compiler_e2e_ddc_sound_test

Similar to #45713.

/cc @Markzipan

@alexmarkov alexmarkov added gardening area-web Use area-web for Dart web related issues, including the DDC and dart2js compilers and JS interop. web-eval evaluation support on the web labels Mar 15, 2023
@Markzipan
Copy link
Contributor

Our bots have a timeout of ~240s (4 min), so our newly added tests have likely pushed us just beyond this limit. I'll look at a smarter way of writing these kinds of tests of avoid this blow-up.

@alexmarkov
Copy link
Contributor Author

Similarly, pkg/dev_compiler/test/expression_compiler/expression_compiler_e2e_ddc_unsound_test turned from flaky to Timeout.

Log: https://dart-ci.appspot.com/log/pkg-win-release/unittest-asserts-release-win/24077/pkg/dev_compiler/test/expression_compiler/expression_compiler_e2e_ddc_unsound_test

@alexmarkov
Copy link
Contributor Author

pkg/dev_compiler/test/expression_compiler/expression_compiler_e2e_amd_unsound_test turned from flaky to Timeout on unittest-asserts-debug-linux configuration (pkg-linux-debug bot).

https://dart-ci.appspot.com/log/pkg-linux-debug/unittest-asserts-debug-linux/16791/pkg/dev_compiler/test/expression_compiler/expression_compiler_e2e_amd_unsound_test

@annagrin annagrin self-assigned this Mar 30, 2023
@annagrin annagrin added the P2 A bug or feature request we're likely to work on label Mar 30, 2023
@sigmundch
Copy link
Member

Just to keep everyone updated: the plan is to split the test in pieces, @nshahan has https://dart-review.googlesource.com/c/sdk/+/293384 in progress to do so.

@nshahan
Copy link
Contributor

nshahan commented Apr 5, 2023

My change has landed and ideally this fixes all the flakes. Wouldn't that be great!

Realistically we probably still have flaky code in these tests that needs to be identified and fixed but I hope that now that they have been sharded the individual test timeouts will prevent the entire suite from timing out and getting killed by the infra. Then maybe we will find better clues to what is failing in the logs.

Since the test in this issue is now obsolete I'm going to close this and we can open a new issue if we start seeing new failures or flakes in the new suites.

@nshahan nshahan closed this as completed Apr 5, 2023
copybara-service bot pushed a commit that referenced this issue Jul 18, 2023
Fix timeout in expression compiler tests

Closes: #51740
Change-Id: I8fd2a321450b4a10235c97af640714a93c805f85
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/314620
Commit-Queue: Anna Gringauze <annagrin@google.com>
Reviewed-by: Mark Zhou <markzipan@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area-web Use area-web for Dart web related issues, including the DDC and dart2js compilers and JS interop. dev-compiler-test gardening P2 A bug or feature request we're likely to work on web-dev-compiler web-eval evaluation support on the web
Projects
None yet
Development

No branches or pull requests

6 participants