-
Notifications
You must be signed in to change notification settings - Fork 3.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add a travis job for testing PR stability #3975
Conversation
77b676b
to
37f4262
Compare
19a3806
to
9f030d7
Compare
test |
9f030d7
to
0f3ec7c
Compare
Testing in firefoxFiles changed: |
Testing in chromeFiles changed: |
0f3ec7c
to
587a65f
Compare
Testing in Chrome
Test runs done
|
Testing in Firefox
Test runs done
|
587a65f
to
5700ff3
Compare
Testing in Firefox
Got unstable results:
|
Testing in Chrome
Got unstable results:
|
@Ms2ger r? |
5700ff3
to
b07aad8
Compare
Go ahead and merge. |
a68cd0e
to
93152fa
Compare
Testing in Firefox
==Unstable results==
==All results==
|
Testing in Chrome
==Unstable results==
==All results==
|
The purpose of the job is to identify poorly-written, unstable, tests as early in the cycle as possible. To this end we use wptrunner to run all the changed tests in the PR in Firefox and Chrome. If 10 runs of the tests don't all give a consisent result then the job fails. Adding Edge and Safari should be possible, but will be challenging because of their strict platform dependencies.
93152fa
to
a486670
Compare
Testing in Firefox
All results were stable All results
|
Testing in Chrome
All results were stable All results
|
a486670
to
3da6633
Compare
Testing in Chrome
No tests run. |
Testing in Firefox
No tests run. |
The purpose of the job is to identify poorly-written, unstable, tests as
early in the cycle as possible. To this end we use wptrunner to run all
the changed tests in the PR in Firefox. If 10 runs of the tests don't
all give a consisent result then the job fails.
Adding runs in Chrome should be quite straightforward, adding Edge and
Safari may be more difficult because of their strict platform dependencies.