Skip to content

REGRESSION (iOS 18): 5 WPT CSS layout tests are constantly failing (ImageOnlyFailure).#35593

Merged
webkit-commit-queue merged 1 commit intoWebKit:mainfrom
vitorroriz:eng/REGRESSION-iOS-18-5-WPT-CSS-layout-tests-are-constantly-failing-ImageOnlyFailure-
Oct 23, 2024
Merged

REGRESSION (iOS 18): 5 WPT CSS layout tests are constantly failing (ImageOnlyFailure).#35593
webkit-commit-queue merged 1 commit intoWebKit:mainfrom
vitorroriz:eng/REGRESSION-iOS-18-5-WPT-CSS-layout-tests-are-constantly-failing-ImageOnlyFailure-

Conversation

@vitorroriz
Copy link
Contributor

@vitorroriz vitorroriz commented Oct 22, 2024

d0deb00

REGRESSION (iOS 18): 5 WPT CSS layout tests are constantly failing (ImageOnlyFailure).
https://bugs.webkit.org/show_bug.cgi?id=277933
rdar://133651925

Reviewed by Tim Nguyen.

Allowing fuzzy tolerance to the following tests.

Tests diff by very few pixels (example: maxDifference=0-123; totalPixels=1).

I can just observe it when running our test suite. When opening the test file on
 Safari/Minibrowser I observe no apparent clipping or differences between test/expected.

I believe this is being introduced by anti-aliasing during test for some reason and it should not have user impact.

* LayoutTests/fast/text/text-underline-position-under.html:
* LayoutTests/imported/w3c/web-platform-tests/css/css-content/quotes-025.html:
* LayoutTests/imported/w3c/web-platform-tests/css/css-content/quotes-026.html:
* LayoutTests/imported/w3c/web-platform-tests/css/css-content/quotes-027.html:
* LayoutTests/imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-fullwidth-004.xht:
* LayoutTests/imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-fullwidth-005.xht:
* LayoutTests/platform/ios/TestExpectations:

Canonical link: https://commits.webkit.org/285585@main

f247958

Misc iOS, visionOS, tvOS & watchOS macOS Linux Windows
✅ 🧪 style ✅ 🛠 ios ✅ 🛠 mac ✅ 🛠 wpe ✅ 🛠 win
✅ 🛠 ios-sim ✅ 🛠 mac-AS-debug ✅ 🧪 wpe-wk2 ✅ 🧪 win-tests
✅ 🧪 webkitperl ✅ 🧪 ios-wk2 ✅ 🧪 api-mac ✅ 🧪 api-wpe
✅ 🧪 ios-wk2-wpt ✅ 🧪 mac-wk1 ✅ 🛠 wpe-cairo
✅ 🧪 api-ios ✅ 🧪 mac-wk2 ✅ 🛠 gtk
⏳ 🛠 vision 🧪 mac-AS-debug-wk2 ✅ 🧪 gtk-wk2
🛠 vision-sim ✅ 🧪 mac-wk2-stress ✅ 🧪 api-gtk
✅ 🛠 🧪 merge ⏳ 🧪 vision-wk2 ✅ 🧪 mac-intel-wk2
✅ 🛠 tv
✅ 🛠 tv-sim
✅ 🛠 watch
✅ 🛠 watch-sim

@vitorroriz vitorroriz self-assigned this Oct 22, 2024
@vitorroriz vitorroriz added the CSS Cascading Style Sheets implementation label Oct 22, 2024
Copy link
Member

@nt1m nt1m left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please export to WPT

@vitorroriz vitorroriz added the merge-queue Applied to send a pull request to merge-queue label Oct 23, 2024
…mageOnlyFailure).

https://bugs.webkit.org/show_bug.cgi?id=277933
rdar://133651925

Reviewed by Tim Nguyen.

Allowing fuzzy tolerance to the following tests.

Tests diff by very few pixels (example: maxDifference=0-123; totalPixels=1).

I can just observe it when running our test suite. When opening the test file on
 Safari/Minibrowser I observe no apparent clipping or differences between test/expected.

I believe this is being introduced by anti-aliasing during test for some reason and it should not have user impact.

* LayoutTests/fast/text/text-underline-position-under.html:
* LayoutTests/imported/w3c/web-platform-tests/css/css-content/quotes-025.html:
* LayoutTests/imported/w3c/web-platform-tests/css/css-content/quotes-026.html:
* LayoutTests/imported/w3c/web-platform-tests/css/css-content/quotes-027.html:
* LayoutTests/imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-fullwidth-004.xht:
* LayoutTests/imported/w3c/web-platform-tests/css/css-text/text-transform/text-transform-fullwidth-005.xht:
* LayoutTests/platform/ios/TestExpectations:

Canonical link: https://commits.webkit.org/285585@main
@webkit-commit-queue webkit-commit-queue force-pushed the eng/REGRESSION-iOS-18-5-WPT-CSS-layout-tests-are-constantly-failing-ImageOnlyFailure- branch from f247958 to d0deb00 Compare October 23, 2024 04:13
@webkit-commit-queue
Copy link
Collaborator

Committed 285585@main (d0deb00): https://commits.webkit.org/285585@main

Reviewed commits have been landed. Closing PR #35593 and removing active labels.

@webkit-commit-queue webkit-commit-queue merged commit d0deb00 into WebKit:main Oct 23, 2024
@webkit-commit-queue webkit-commit-queue removed the merge-queue Applied to send a pull request to merge-queue label Oct 23, 2024
@vitorroriz vitorroriz deleted the eng/REGRESSION-iOS-18-5-WPT-CSS-layout-tests-are-constantly-failing-ImageOnlyFailure- branch February 26, 2025 22:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CSS Cascading Style Sheets implementation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

Comments