Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✅ Skip mutliple flaky tests #19796

Merged
merged 2 commits into from Dec 11, 2018

Conversation

danielrozenberg
Copy link
Member

No description provided.

Copy link
Contributor

@rsimha rsimha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM pending TODOs.

@choumx made a good point about keeping these running on local chrome even if we do disable them on Sauce Labs. (Shouldn't block this PR.)

@aghassemi
Copy link
Contributor

@danielrozenberg @rsimha Skipping tests that used to pass before environment change is a bit risky IMO. Could we instead of skipping, have SauceLabs keep running Chrome 70 in blocking mode and 71 in non-blocking mode and then resolve the issues? Also some of these failures may have to do with the new environment rather than Chrome 71 itself. See this investigation by @cvializ for example: #19788 (comment)

@aghassemi
Copy link
Contributor

aghassemi commented Dec 12, 2018

The tests skipped here all have to do the the size of the iframe that Karma uses to embed the test. It is very likely similar to #19788 (comment) as a runner + Saucelabs issue.

noranazmy pushed a commit to noranazmy/amphtml that referenced this pull request Mar 22, 2019
* Skip a flaky test

* Skip two more tests and fix misconfigured skip in previous commit
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants