Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix tests with harness status ERROR or TIMEOUT #11269

Closed
zcorpan opened this issue May 31, 2018 · 22 comments
Closed

Fix tests with harness status ERROR or TIMEOUT #11269

zcorpan opened this issue May 31, 2018 · 22 comments
Assignees

Comments

@zcorpan
Copy link
Member

zcorpan commented May 31, 2018

From web-platform-tests/results-collection#478 (comment)

5 tests reporting ERROR in all browsers

42 tests reporting TIMEOUT in all browsers

82 tests inconsistently reporting either ERROR or TIMEOUT in all browsers

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

websockets/interfaces/WebSocket/events/018.html
websockets/interfaces/WebSocket/events/018.html?wss
service-workers/service-worker/clients-get-client-types.https.html
service-workers/service-worker/clients-get.https.html

I couldn't reproduce ERROR for these.

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

websockets/cookies/004.html?wss
websockets/cookies/005.html?wss
websockets/cookies/004.html
websockets/cookies/005.html

I couldn't reproduce.

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

encoding/legacy-mb-korean/euc-kr/euckr-encode-form-errors-hangul.html

Should be fixed by #11016.

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

css/css-variables/variable-transitions-value-before-transition-property-variable.html
css/css-variables/variable-transitions-from-no-value.html

These pass in EdgeHTML 17 (tested with browserstack). I'll report bugs for the others.

https://bugzilla.mozilla.org/show_bug.cgi?id=1465776
https://bugs.webkit.org/show_bug.cgi?id=186147
https://bugs.chromium.org/p/chromium/issues/detail?id=791529

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

css/css-fonts/variations/font-style-interpolation.html

Only times out in chromium for me, and there's a bug:
https://bugs.chromium.org/p/chromium/issues/detail?id=809935

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

css/css-transitions/transitions-animatable-properties-01.html

Fixed in https://github.com/web-platform-tests/wpt/pull/11057/files#diff-07c4bd3eddc86a245b2129fca185cffd

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

workers/opaque-origin.html

Fixed in #11189

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

cookies/secure/set-from-wss.https.sub.html
cookies/secure/set-from-ws.sub.html

I can't reproduce these.

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

xhr/abort-after-stop.htm

Fixed in #11091

@zcorpan
Copy link
Member Author

zcorpan commented May 31, 2018

beacon/beacon-navigate.html

This seems to fail only in Chromium, filed https://bugs.chromium.org/p/chromium/issues/detail?id=848275

zcorpan added a commit that referenced this issue Jun 5, 2018
This should fix the test
html/infrastructure/safe-passing-of-structured-data/shared-array-buffers/serialization-via-idb.any.worker.html

Part of #11269.
@zcorpan
Copy link
Member Author

zcorpan commented Jun 5, 2018

html/editing/focus/focus-02.html

Filed #11349

@zcorpan
Copy link
Member Author

zcorpan commented Jun 5, 2018

service-workers/service-worker/state.https.html
service-workers/service-worker/worker-interception-redirect.https.html

These seem OK now in wpt.fyi and locally.

@zcorpan
Copy link
Member Author

zcorpan commented Jun 5, 2018

I've now gone through all of the tests, so closing. When the PRs are merged we can do another round to see what's left to fix.

@zcorpan zcorpan closed this as completed Jun 5, 2018
zcorpan pushed a commit that referenced this issue Jun 5, 2018
Ms2ger pushed a commit that referenced this issue Jun 5, 2018
This should fix the test
html/infrastructure/safe-passing-of-structured-data/shared-array-buffers/serialization-via-idb.any.worker.html

Part of #11269.
zcorpan added a commit that referenced this issue Jun 8, 2018
zcorpan added a commit that referenced this issue Jun 11, 2018
zcorpan added a commit that referenced this issue Jun 19, 2018
zcorpan added a commit that referenced this issue Jun 19, 2018
foolip pushed a commit that referenced this issue Jun 19, 2018
Some tests, e.g., [1], expect testharness.js to exist in the script.

Part of #11269.

[1] html/infrastructure/safe-passing-of-structured-data/shared-array-buffers/serialization-via-idb.any.html
zcorpan added a commit that referenced this issue Jun 21, 2018
lukebjerring pushed a commit to lukebjerring/wpt that referenced this issue Jun 26, 2018
lukebjerring pushed a commit to lukebjerring/wpt that referenced this issue Jun 29, 2018
zcorpan added a commit that referenced this issue Aug 22, 2018
zcorpan added a commit that referenced this issue Aug 27, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant