Update Webrender #21725

pyfisch · 2018-09-15T19:25:23Z

New version is
9156a4465f6ad715a0206cdd9a7e9a6f0385fbd6

./mach build -d does not report any errors
./mach test-tidy does not report any errors
These changes do not require tests because just updating WR

This change is

highfive · 2018-09-15T19:25:27Z

Heads up! This PR modifies the following files:

@emilio: components/layout/display_list/webrender_helpers.rs, components/layout/display_list/builder.rs

highfive · 2018-09-15T19:25:28Z

Warning

These commits modify layout code, but no tests are modified. Please consider adding a test!

pyfisch · 2018-09-15T19:26:55Z

@bors-servo try=wpt

bors-servo · 2018-09-15T19:27:00Z

⌛ Trying commit 27f89c1 with merge a734a7a...


        Auto merge of #21725 - pyfisch:update-wr, r=<try>

Update Webrender New version is 9156a4465f6ad715a0206cdd9a7e9a6f0385fbd6 --- - [x] `./mach build -d` does not report any errors - [x] `./mach test-tidy` does not report any errors - [x] These changes do not require tests because just updating WR  --- This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/21725)

bors-servo · 2018-09-15T19:47:30Z

💔 Test failed - linux-rel-css

pyfisch · 2018-09-15T20:02:04Z

wpt:

{"status": "FAIL", "group": "default", "message": "/css/CSS2/floats-clear/clear-on-parent-and-child.html b303f7b1e7a369ab78edcb4d8ed954c77e39e37a\n/css/reference/ref-filled-green-200px-square.html 180f8d33743fd8d6be409074c105cdd53ad49312\nTesting b303f7b1e7a369ab78edcb4d8ed954c77e39e37a == 180f8d33743fd8d6be409074c105cdd53ad49312", "stack": null, "subtest": null, "test": "/css/CSS2/floats-clear/clear-on-parent-and-child.html", "line": 3584, "action": "test_result", "expected": "PASS"}
{"status": "FAIL", "group": "default", "message": "/css/css-backgrounds/scroll-positioned-multiple-background-images.html fb94a58677dd69d36c745d5f12071de87f1279c6\n/css/css-backgrounds/reference/60x60-green-background.html 7800904ac377ba85eb0edc9a895a0ddd214ec001\nTesting fb94a58677dd69d36c745d5f12071de87f1279c6 == 7800904ac377ba85eb0edc9a895a0ddd214ec001", "stack": null, "subtest": null, "test": "/css/css-backgrounds/scroll-positioned-multiple-background-images.html", "line": 23441, "action": "test_result", "expected": "PASS"}
{"status": "FAIL", "group": "default", "message": "/css/css-transforms/matrix/svg-matrix-061.html 4e6ec2a4e7504e5c4bb739eb4fad793251d3180f\n/css/css-transforms/matrix/reference/svg-matrix-four-color-ref.html 91434ac6ea51711fb229c7a0a460632227c659c1\nTesting 4e6ec2a4e7504e5c4bb739eb4fad793251d3180f == 91434ac6ea51711fb229c7a0a460632227c659c1", "stack": null, "subtest": null, "test": "/css/css-transforms/matrix/svg-matrix-061.html", "line": 30853, "action": "test_result", "expected": "PASS"}
{"status": "FAIL", "group": "default", "message": "/css/css-transforms/transform-table-006.html c436b96bd5d8760d073b745c257968843c2f3c22\n/css/css-transforms/transform-blank-ref.html b81be0af214ed7113846c7cd94d9d9d57fe9efe8\nTesting c436b96bd5d8760d073b745c257968843c2f3c22 == b81be0af214ed7113846c7cd94d9d9d57fe9efe8", "stack": null, "subtest": null, "test": "/css/css-transforms/transform-table-006.html", "line": 30993, "action": "test_result", "expected": "PASS"}
{"status": "PASS", "group": "default", "message": null, "stack": null, "subtest": null, "test": "/_mozilla/css/border_black_ridge_b.html", "line": 33997, "action": "test_result", "expected": "FAIL"}
{"status": "PASS", "group": "default", "message": null, "stack": null, "subtest": null, "test": "/_mozilla/css/border_black_ridge_a.html", "line": 48498, "action": "test_result", "expected": "FAIL"}
{"status": "FAIL", "group": "default", "message": "assert_equals: Should hit the scrollbox contents expected \"DIV\" but got \"HTML\"", "stack": "@http://web-platform.test:8000/css/cssom-view/elementFromPoint-dynamic-anon-box.html:39:3\nTest.prototype.step@http://web-platform.test:8000/resources/testharness.js:1558:20\ntest@http://web-platform.test:8000/resources/testharness.js:544:9\n@http://web-platform.test:8000/css/cssom-view/elementFromPoint-dynamic-anon-box.html:38:1\n", "subtest": "Link should be clickable after hiding a scrollbox with an anonymous table inside", "test": "/css/cssom-view/elementFromPoint-dynamic-anon-box.html", "line": 75877, "action": "test_result", "expected": "PASS"}
{"status": "FAIL", "group": "default", "message": "assert_equals: elementFromPoint didn't return the correct element expected \"targetDiv\" but got \"\"", "stack": "@http://web-platform.test:8000/css/cssom-view/elementFromPoint-001.html:30:13\nTest.prototype.step@http://web-platform.test:8000/resources/testharness.js:1558:20\ntest@http://web-platform.test:8000/resources/testharness.js:544:9\n@http://web-platform.test:8000/css/cssom-view/elementFromPoint-001.html:29:9\n", "subtest": "CSSOM View - 5 - extensions to the Document interface", "test": "/css/cssom-view/elementFromPoint-001.html", "line": 137495, "action": "test_result", "expected": "PASS"}

css:

{"status": "PASS", "group": "default", "message": null, "stack": null, "subtest": null, "test": "/css/CSS2/borders/groove-default.html", "line": 9063, "action": "test_result", "expected": "FAIL"}
{"status": "FAIL", "group": "default", "message": "/css/css-backgrounds/background-attachment-local/attachment-local-positioning-2.html eaeebb2839df1cf7055b4ee85b03c121243febe6\n/css/css-backgrounds/background-attachment-local/attachment-local-positioning-2-ref.html 5a2ec2bcffef32babf5ed006e575c95b40f17461\nTesting eaeebb2839df1cf7055b4ee85b03c121243febe6 == 5a2ec2bcffef32babf5ed006e575c95b40f17461", "stack": null, "subtest": null, "test": "/css/css-backgrounds/background-attachment-local/attachment-local-positioning-2.html", "line": 19284, "action": "test_result", "expected": "PASS"}
{"status": "FAIL", "group": "default", "message": "/css/css-backgrounds/background-attachment-local/attachment-scroll-positioning-1.html cda19fcbd5b8404f0ae13d72de40dbca9bb04146\n/css/css-backgrounds/background-attachment-local/attachment-scroll-positioning-1-ref.html b1fa7ca2fdf4212c15aee8b20a8e35a687ba3735\nTesting cda19fcbd5b8404f0ae13d72de40dbca9bb04146 == b1fa7ca2fdf4212c15aee8b20a8e35a687ba3735", "stack": null, "subtest": null, "test": "/css/css-backgrounds/background-attachment-local/attachment-scroll-positioning-1.html", "line": 19808, "action": "test_result", "expected": "PASS"}
{"status": "PASS", "group": "default", "message": null, "stack": null, "subtest": null, "test": "/css/compositing/mix-blend-mode/mix-blend-mode-animation.html", "line": 20086, "action": "test_result", "expected": "FAIL"}
{"status": "FAIL", "group": "default", "message": "/css/compositing/mix-blend-mode/mix-blend-mode-blended-with-transform-and-perspective.html 5ad2bac6c31d0d3298124dd51067ed9b080d2165\n/css/compositing/mix-blend-mode/reference/mix-blend-mode-blended-with-transform-and-perspective-ref.html 147b375c8f1e8d0fec76c36919c7bf7a7ec18b60\nTesting 5ad2bac6c31d0d3298124dd51067ed9b080d2165 == 147b375c8f1e8d0fec76c36919c7bf7a7ec18b60", "stack": null, "subtest": null, "test": "/css/compositing/mix-blend-mode/mix-blend-mode-blended-with-transform-and-perspective.html", "line": 22174, "action": "test_result", "expected": "PASS"}
{"status": "PASS", "group": "default", "message": null, "stack": null, "subtest": null, "test": "/css/CSS2/borders/ridge-default.html", "line": 30251, "action": "test_result", "expected": "FAIL"}
{"status": "FAIL", "group": "default", "message": "/css/compositing/mix-blend-mode/mix-blend-mode-paragraph.html f6cb58abcc1d2274b393d5d49c274f70ea9bfc8b\n/css/compositing/mix-blend-mode/reference/mix-blend-mode-paragraph-ref.html 737b4ae888e9d0b5d4a98f8e1bcb0cb7b7e8002b\nTesting f6cb58abcc1d2274b393d5d49c274f70ea9bfc8b == 737b4ae888e9d0b5d4a98f8e1bcb0cb7b7e8002b", "stack": null, "subtest": null, "test": "/css/compositing/mix-blend-mode/mix-blend-mode-paragraph.html", "line": 31281, "action": "test_result", "expected": "PASS"}

/css/CSS2/borders/groove-default.html, border_black_ridge_a.html, ridge_default.html and border_black_ridge_b.html pass after servo/webrender#3010

pyfisch · 2018-09-16T19:38:21Z

The coordinate systems were changed in some way in the new WebRender as seen in these two tests.

/css/css-backgrounds/scroll-positioned-multiple-background-images.html
/css/compositing/mix-blend-mode/mix-blend-mode-blended-with-transform-and-perspective.html

@kvark Can you give me hint what was changed and how the DL from servo needs to be changed?

emilio · 2018-09-16T22:02:36Z

cc @gw3583, since he's likely to be around earlier. See the comment on top ^.

kvark · 2018-09-17T15:00:29Z

@pyfisch
WR changes: servo/webrender@38f3b57...9156a44

Looking through this list, there isn't anything striking as an API semantics change. Most (if not all) the things are just fixing the internal processing (basically, bugs) and optimizing the data. Given that there isn't a lot of changes in this PR, it should be easy to get a narrower regression range.

pyfisch · 2018-09-17T19:01:47Z

Thanks @kvark for having a look.

Debugging notes:

no regression on a16e311b
no regression on 9399766
no regressions on 5fa5c46e
one regression at 69dae1fe
- /css/css-transforms/transform-table-006.html
at c89f16a2 tests fail
at 3fa5eb8a tests fail
at 5e1f9b9a these tests fail:
- /css/css-backgrounds/background-attachment-local/attachment-scroll-positioning-1.html
- /css/CSS2/floats-clear/clear-on-parent-and-child.html
- /css/css-backgrounds/background-attachment-local/attachment-local-positioning-2.html
- /css/css-backgrounds/scroll-positioned-multiple-background-images.html
- /css/css-transforms/transform-table-006.html

kvark · 2018-09-17T20:00:41Z

Thanks @pyfisch ! This is still a fairly large window of 53 commits.
Also, do you happen to have the reflog (or a link to it) with those reftest errors?

pyfisch · 2018-09-17T20:17:42Z

This is still a fairly large window of 53 commits.

I am narrowing it down further. Basically a binary search for the first commit where a test fails.
Now the window is only 34 commits (turns out I suck at finding the middle element)

I am not sure what you mean by "reflog". I run this command to test:

#!/bin/bash

./mach test-wpt --include \
tests/wpt/web-platform-tests/css/CSS2/floats-clear/clear-on-parent-and-child.html \
tests/wpt/web-platform-tests/css/css-backgrounds/scroll-positioned-multiple-background-images.html \
tests/wpt/web-platform-tests/css/css-transforms/matrix/svg-matrix-061.html \
tests/wpt/web-platform-tests/css/css-transforms/transform-table-006.html \
\
tests/wpt/web-platform-tests/css/css-backgrounds/background-attachment-local/attachment-local-positioning-2.html \
tests/wpt/web-platform-tests/css/css-backgrounds/background-attachment-local/attachment-scroll-positioning-1.html \
tests/wpt/web-platform-tests/css/compositing/mix-blend-mode/mix-blend-mode-blended-with-transform-and-perspective.html \
tests/wpt/web-platform-tests/css/compositing/mix-blend-mode/mix-blend-mode-paragraph.html

jdm · 2018-09-17T20:20:02Z

@pyfisch If you use --log-raw logfile, the resulting log can be uploaded to http://hoppipolla.co.uk/410/reftest-analyser-structured.xhtml and screenshots of the differences can be produced.

pyfisch · 2018-09-17T20:58:39Z

Reflog: https://gist.github.com/pyfisch/bab9fb65e2b2711413e8c41c22531b81
Commit range: servo/webrender@5fa5c46...3fa5eb8

kvark · 2018-09-18T00:59:01Z

@pyfisch thank you! We are already within 3 PRs of finding the exact breaking change. If you can't bisect it once (or twice?) more, I'll get to it tomorrow. We'll need to have the corresponding reftests locally on WR side anyway so that it doesn't happen again.

pyfisch · 2018-09-18T07:20:20Z

In servo/webrender@5fa5c46...69dae1f the test /css/css-transforms/transform-table-006.html regresses.
In servo/webrender@69dae1f...c89f16a four more tests fail.

There is at least one more commit where a regression is introduced as after all changes are applied 8 tests fail, but at servo/webrender@69dae1f...c89f16a only 5 do fail.

kvark · 2018-09-18T13:49:11Z

Thank you! I filed servo/webrender#3077 and servo/webrender#3078 on WR side to investigate.

nical · 2018-09-18T15:46:52Z

The change in #2992 enforces scene building to happen on a dedicated thread.
All transactions that go through the scene builder thread preserve their ordering while the ones that don't use the scene builder thread can skip ahead and use the previous scene. That's how Gecko can keep scrolling and applying async animations while a scene is taking too long (as it can happen).

Most transactions (the ones that are created using Transaction::new()) by default use the scene builder. Some transactions by default don't use the scene builder (for example hit-testing stuff and api.set_window_parameters(..)) which is a bit confusing, sorry.

If async scene building caused a regression in servo it most likely means that some messages that were ordered before are not ordered anymore. One way to check is to make sure that all api calls that create a transaction have the use_scene_builder_thread flag set to true to avoid letting them skip ahead of async scene building, which should correspond to servo's behavior before async scene building.

jdm · 2018-10-02T23:10:40Z

I think we should go ahead and accept the regressions that come with this WR update. We need it in order to fix #21820, which makes our windows nightlies completely unusable.

bors-servo · 2018-10-12T12:41:12Z

⌛ Testing commit 4e5b3bc with merge e46f127...


        Auto merge of #21725 - pyfisch:update-wr, r=jdm

Update Webrender New version is 9156a4465f6ad715a0206cdd9a7e9a6f0385fbd6 --- - [x] `./mach build -d` does not report any errors - [x] `./mach test-tidy` does not report any errors - [x] These changes do not require tests because just updating WR  --- This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/21725)

bors-servo · 2018-10-12T13:08:56Z

💔 Test failed - linux-rel-wpt

jdm · 2018-10-12T13:39:52Z

@bors-servo retry

#21067

bors-servo · 2018-10-12T14:46:03Z

⌛ Testing commit 4e5b3bc with merge 78c2fcf...


        Auto merge of #21725 - pyfisch:update-wr, r=jdm

Update Webrender New version is 9156a4465f6ad715a0206cdd9a7e9a6f0385fbd6 --- - [x] `./mach build -d` does not report any errors - [x] `./mach test-tidy` does not report any errors - [x] These changes do not require tests because just updating WR  --- This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/21725)

bors-servo · 2018-10-12T15:26:08Z

💔 Test failed - mac-rel-wpt2

jdm · 2018-10-12T15:39:30Z

@bors-servo retry

#21930

bors-servo · 2018-10-12T16:49:26Z

⌛ Testing commit 4e5b3bc with merge 7e78edc...


        Auto merge of #21725 - pyfisch:update-wr, r=jdm

Update Webrender New version is 9156a4465f6ad715a0206cdd9a7e9a6f0385fbd6 --- - [x] `./mach build -d` does not report any errors - [x] `./mach test-tidy` does not report any errors - [x] These changes do not require tests because just updating WR  --- This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/21725)

bors-servo · 2018-10-12T17:51:36Z

☀️ Test successful - android, android-x86, arm32, arm64, linux-dev, linux-rel-css, linux-rel-wpt, mac-dev-unit, mac-rel-css1, mac-rel-css2, mac-rel-wpt1, mac-rel-wpt2, mac-rel-wpt3, mac-rel-wpt4, status-taskcluster, windows-msvc-dev
Approved by: jdm
Pushing 7e78edc to master...

bors-servo · 2018-10-12T17:51:50Z

☀️ Test successful - android, android-x86, arm32, arm64, linux-dev, linux-rel-css, linux-rel-wpt, mac-dev-unit, mac-rel-css1, mac-rel-css2, mac-rel-wpt1, mac-rel-wpt2, mac-rel-wpt3, mac-rel-wpt4, status-taskcluster, windows-msvc-dev
Approved by: jdm
Pushing 7e78edc to master...


        Bug 1500260 - Update servo malloc_size_of after webrender update. r=e…

…milio This cherry-picks part of servo/servo#21725.


        Bug 1500260 - Update servo malloc_size_of after webrender update. r=e…

…milio This cherry-picks part of servo/servo#21725.


        Bug 1500260 - Update servo malloc_size_of after webrender update. r=e…

…milio This cherry-picks part of servo/servo#21725. UltraBlame original commit: 4fb710869a7746539cbaae952ec26af4286ceb2d


        Bug 1500260 - Update servo malloc_size_of after webrender update. r=e…

…milio This cherry-picks part of servo/servo#21725. UltraBlame original commit: 4fb710869a7746539cbaae952ec26af4286ceb2d


        Bug 1500260 - Update servo malloc_size_of after webrender update. r=e…

…milio This cherry-picks part of servo/servo#21725. UltraBlame original commit: 4fb710869a7746539cbaae952ec26af4286ceb2d

highfive assigned ferjm Sep 15, 2018

highfive added the S-awaiting-review label Sep 15, 2018

pyfisch mentioned this pull request Sep 15, 2018

[WIP] Update WR (various optimizations, color image support). #21412

Closed

highfive added the S-tests-failed label Sep 15, 2018

kvark mentioned this pull request Sep 17, 2018

Run Servo with gfx szeged/webrender#173

Open

1 of 2 tasks complete

This was referenced Sep 18, 2018

Regression in Servo /css/css-transforms/transform-table-006.html servo/webrender#3077

Open

Regression in Servo /css/css-backgrounds tests servo/webrender#3078

Open

KiChjang mentioned this pull request Sep 29, 2018

Windows nightly crashes at startup #21820

Closed

jdm mentioned this pull request Oct 9, 2018

Use use_scene_builder_thread on webrender transactions #21896

Closed

jdm force-pushed the pyfisch:update-wr branch from 27f89c1 to 37cd38e Oct 9, 2018

highfive added S-awaiting-merge and removed S-tests-failed labels Oct 12, 2018

highfive added S-tests-failed and removed S-awaiting-merge labels Oct 12, 2018

highfive added S-awaiting-merge and removed S-tests-failed labels Oct 12, 2018

highfive added S-tests-failed and removed S-awaiting-merge labels Oct 12, 2018

highfive added S-awaiting-merge and removed S-tests-failed labels Oct 12, 2018

bors-servo merged commit 4e5b3bc into servo:master Oct 12, 2018
3 checks passed

3 checks passed

continuous-integration/appveyor/pr AppVeyor build succeeded
Details

continuous-integration/travis-ci/pr The Travis CI build passed
Details

homu Test successful
Details

highfive removed the S-awaiting-merge label Oct 12, 2018

moz-v2v-gh pushed a commit to mozilla/gecko-dev that referenced this pull request Oct 18, 2018

Bug 1500260 - Update servo malloc_size_of after webrender update. r=e…

1feab67

…milio This cherry-picks part of servo/servo#21725.

xeonchen pushed a commit to xeonchen/gecko-cinnabar that referenced this pull request Oct 19, 2018

Bug 1500260 - Update servo malloc_size_of after webrender update. r=e…

1f3d847

…milio This cherry-picks part of servo/servo#21725.

jdm mentioned this pull request Nov 16, 2018

Intermittent failure in /css/CSS2/positioning/bottom-113.xht (one of the screenshots is a big black box) #22062

Closed

servo / servo

Update Webrender #21725

Update Webrender #21725

pyfisch commented Sep 15, 2018 •

edited by SimonSapin

highfive commented Sep 15, 2018

highfive commented Sep 15, 2018

pyfisch commented Sep 15, 2018

bors-servo commented Sep 15, 2018

bors-servo commented Sep 15, 2018

pyfisch commented Sep 15, 2018 •

edited

pyfisch commented Sep 16, 2018

emilio commented Sep 16, 2018

kvark commented Sep 17, 2018

pyfisch commented Sep 17, 2018 •

edited

kvark commented Sep 17, 2018

pyfisch commented Sep 17, 2018

jdm commented Sep 17, 2018

pyfisch commented Sep 17, 2018

kvark commented Sep 18, 2018

pyfisch commented Sep 18, 2018 •

edited

kvark commented Sep 18, 2018

nical commented Sep 18, 2018 •

edited

jdm commented Oct 2, 2018

bors-servo commented Oct 12, 2018

bors-servo commented Oct 12, 2018

jdm commented Oct 12, 2018

bors-servo commented Oct 12, 2018

bors-servo commented Oct 12, 2018

jdm commented Oct 12, 2018

bors-servo commented Oct 12, 2018

bors-servo commented Oct 12, 2018

bors-servo commented Oct 12, 2018

servo / servo

Join GitHub today

Update Webrender #21725

Update Webrender #21725

Conversation

pyfisch commented Sep 15, 2018 • edited by SimonSapin

highfive commented Sep 15, 2018

highfive commented Sep 15, 2018

pyfisch commented Sep 15, 2018

bors-servo commented Sep 15, 2018

bors-servo commented Sep 15, 2018

pyfisch commented Sep 15, 2018 • edited

pyfisch commented Sep 16, 2018

emilio commented Sep 16, 2018

kvark commented Sep 17, 2018

pyfisch commented Sep 17, 2018 • edited

kvark commented Sep 17, 2018

pyfisch commented Sep 17, 2018

jdm commented Sep 17, 2018

pyfisch commented Sep 17, 2018

kvark commented Sep 18, 2018

pyfisch commented Sep 18, 2018 • edited

kvark commented Sep 18, 2018

nical commented Sep 18, 2018 • edited

jdm commented Oct 2, 2018

bors-servo commented Oct 12, 2018

bors-servo commented Oct 12, 2018

jdm commented Oct 12, 2018

bors-servo commented Oct 12, 2018

bors-servo commented Oct 12, 2018

jdm commented Oct 12, 2018

bors-servo commented Oct 12, 2018

bors-servo commented Oct 12, 2018

bors-servo commented Oct 12, 2018

pyfisch commented Sep 15, 2018 •

edited by SimonSapin

pyfisch commented Sep 15, 2018 •

edited

pyfisch commented Sep 17, 2018 •

edited

pyfisch commented Sep 18, 2018 •

edited

nical commented Sep 18, 2018 •

edited