Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GTK][WPE] Gardening LayoutTests/webrtc/video-disabled-black.html #18181

Conversation

abstractmachines
Copy link
Contributor

@abstractmachines abstractmachines commented Sep 25, 2023

c2c3e60

[GTK][WPE] Gardening LayoutTests/webrtc/video-disabled-black.html

Unreviewed test gardening.

Test was gardened a couple of weeks ago in webkit.org/b/261024; and
webkit.org/b/254212 is also related to this test as a fix. Since
webkit.org/b/254212, test has been flaky; prior to that, it failed in bots.
Generally a flaky test as noted in 261024 which is still open.

Noted in existing bugs 261024, 254212; moved expectations up to glib.

* LayoutTests/platform/glib/TestExpectations: move expectation here for flakiness
* LayoutTests/platform/gtk/TestExpectations:

Canonical link: https://commits.webkit.org/268498@main

f87fa2a

Misc iOS, tvOS & watchOS macOS Linux Windows
βœ… πŸ§ͺ style βœ… πŸ›  ios βœ… πŸ›  mac βœ… πŸ›  wpe βœ… πŸ›  wincairo
βœ… πŸ›  ios-sim βœ… πŸ›  mac-AS-debug βœ… πŸ§ͺ wpe-wk2
βœ… πŸ§ͺ webkitperl βœ… πŸ§ͺ ios-wk2 βœ… πŸ§ͺ api-mac βœ… πŸ›  gtk
βœ… πŸ§ͺ ios-wk2-wpt βœ… πŸ§ͺ mac-wk1 βœ… πŸ§ͺ gtk-wk2
βœ… πŸ§ͺ api-ios βœ… πŸ§ͺ mac-wk2 βœ… πŸ§ͺ api-gtk
βœ… πŸ›  tv βœ… πŸ§ͺ mac-AS-debug-wk2
βœ… πŸ›  tv-sim
βœ… πŸ›  watch
βœ… πŸ›  πŸ§ͺ unsafe-merge βœ… πŸ›  watch-sim

@abstractmachines abstractmachines force-pushed the gardening/gtk-wpe/layouttests/webrtc/video-disabled-black.html branch from 57313fa to 1a8dfbc Compare September 25, 2023 18:46
@abstractmachines abstractmachines force-pushed the gardening/gtk-wpe/layouttests/webrtc/video-disabled-black.html branch from 1a8dfbc to 6679f45 Compare September 25, 2023 18:52
@@ -3470,6 +3470,7 @@ webkit.org/b/261024 svg/text/small-fonts-in-html5.html [ Failure ImageOnlyFailur
webkit.org/b/261024 webrtc/video-maxFramerate.html [ Pass Timeout ]
webkit.org/b/261024 webrtc/video-replace-muted-track.html [ Pass Timeout ]
webkit.org/b/261024 webrtc/video-unmute.html [ Pass Timeout ]
webkit.org/b/261024 webrtc/video-disabled-black.html [ Skip ]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We usually prefer to indicate the possible outcomes of the test (Crash Pass) rather than skipping it.

If a test is skipped then the bots will not run it, so we will not get any further notification if/when the test starts passing back or if it has a different result (like Timeout).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done :) Thanks for the note. Now this just needs proper labels to merge, e.g. unsafe-merge-queue, would appreciate that if you'd add those labels @clopez (and also remove merging-blocked label if applicable). Thanks!

@abstractmachines abstractmachines force-pushed the gardening/gtk-wpe/layouttests/webrtc/video-disabled-black.html branch from 6679f45 to f87fa2a Compare September 26, 2023 15:45
@obyknovenius obyknovenius added the unsafe-merge-queue Applied to send a pull request to merge-queue, but skip building and testing label Sep 27, 2023
Unreviewed test gardening.

Test was gardened a couple of weeks ago in webkit.org/b/261024; and
webkit.org/b/254212 is also related to this test as a fix. Since
webkit.org/b/254212, test has been flaky; prior to that, it failed in bots.
Generally a flaky test as noted in 261024 which is still open.

Noted in existing bugs 261024, 254212; moved expectations up to glib.

* LayoutTests/platform/glib/TestExpectations: move expectation here for flakiness
* LayoutTests/platform/gtk/TestExpectations:

Canonical link: https://commits.webkit.org/268498@main
@webkit-commit-queue webkit-commit-queue force-pushed the gardening/gtk-wpe/layouttests/webrtc/video-disabled-black.html branch from f87fa2a to c2c3e60 Compare September 27, 2023 09:21
@webkit-commit-queue
Copy link
Collaborator

Test gardening commit 268498@main (c2c3e60): https://commits.webkit.org/268498@main

Reviewed commits have been landed. Closing PR #18181 and removing active labels.

@webkit-commit-queue webkit-commit-queue merged commit c2c3e60 into WebKit:main Sep 27, 2023
@webkit-commit-queue webkit-commit-queue removed the unsafe-merge-queue Applied to send a pull request to merge-queue, but skip building and testing label Sep 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
5 participants