Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filter out failed test-perf runs. #19523

Merged

Conversation

@asajeffrey
Copy link
Member

asajeffrey commented Dec 8, 2017

Google Data Studio is a lot happier if the data that's driving it is already filtered. This PR filters out any failed test runs from the CSV file generated by test-perf.


  • ./mach build -d does not report any errors
  • ./mach test-tidy does not report any errors
  • These changes do not require tests because this is test infrastructure

This change is Reviewable

@highfive
Copy link

highfive commented Dec 8, 2017

Heads up! This PR modifies the following files:

@asajeffrey
Copy link
Member Author

asajeffrey commented Dec 8, 2017

@highfive highfive assigned avadacatavra and unassigned pcwalton Dec 8, 2017
@@ -281,10 +281,12 @@ def save_result_csv(results, filename, manifest, expected_runs, base):
'unloadEventStart',
]

successes = list(filter(lambda x: x['domComplete'] != -1, results))

This comment has been minimized.

Copy link
@aneeshusa

aneeshusa Dec 14, 2017

Member

List comprehensions are more idiomatic in Python:

successes = [r for r in results if r['domComplete'] != -1]

This comment has been minimized.

Copy link
@asajeffrey

asajeffrey Dec 18, 2017

Author Member

Fixed. There's quite a few more of those :/ Time to file an E-Easy issue?

@avadacatavra
Copy link
Contributor

avadacatavra commented Dec 18, 2017

@asajeffrey looks good--can you squash please?

@asajeffrey
Copy link
Member Author

asajeffrey commented Dec 18, 2017

Will do when I'm back in front of a computer.

@avadacatavra
Copy link
Contributor

avadacatavra commented Jan 3, 2018

@asajeffrey status on this?

@asajeffrey asajeffrey force-pushed the asajeffrey:test-perf-filter-out-failed-tests branch from b0775e1 to fcc64cf Jan 5, 2018
@asajeffrey
Copy link
Member Author

asajeffrey commented Jan 5, 2018

@avadacatavra er the status is Xmas holiday. I squashed.

@bors-servo r=avadacatavra

@bors-servo
Copy link
Contributor

bors-servo commented Jan 5, 2018

📌 Commit fcc64cf has been approved by avadacatavra

@bors-servo
Copy link
Contributor

bors-servo commented Jan 5, 2018

Testing commit fcc64cf with merge b78888d...

bors-servo added a commit that referenced this pull request Jan 5, 2018
…r=avadacatavra

Filter out failed test-perf runs.

<!-- Please describe your changes on the following line: -->

Google Data Studio is a lot happier if the data that's driving it is already filtered. This PR filters out any failed test runs from the CSV file generated by test-perf.

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [X] `./mach build -d` does not report any errors
- [X] `./mach test-tidy` does not report any errors
- [X] These changes do not require tests because this is test infrastructure

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19523)
<!-- Reviewable:end -->
@bors-servo
Copy link
Contributor

bors-servo commented Jan 5, 2018

💔 Test failed - mac-dev-unit

@asajeffrey
Copy link
Member Author

asajeffrey commented Jan 5, 2018

@bors-servo
Copy link
Contributor

bors-servo commented Jan 5, 2018

Testing commit fcc64cf with merge 753e2bc...

bors-servo added a commit that referenced this pull request Jan 5, 2018
…r=avadacatavra

Filter out failed test-perf runs.

<!-- Please describe your changes on the following line: -->

Google Data Studio is a lot happier if the data that's driving it is already filtered. This PR filters out any failed test runs from the CSV file generated by test-perf.

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [X] `./mach build -d` does not report any errors
- [X] `./mach test-tidy` does not report any errors
- [X] These changes do not require tests because this is test infrastructure

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19523)
<!-- Reviewable:end -->
@highfive highfive removed the S-tests-failed label Jan 5, 2018
@bors-servo
Copy link
Contributor

bors-servo commented Jan 5, 2018

@bors-servo bors-servo merged commit fcc64cf into servo:master Jan 5, 2018
3 checks passed
3 checks passed
continuous-integration/appveyor/pr AppVeyor build succeeded
Details
continuous-integration/travis-ci/pr The Travis CI build passed
Details
homu Test successful
Details
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

6 participants
You can’t perform that action at this time.