Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Merged by Bors] - Improve tester display for multiple editions #2720

Closed
wants to merge 3 commits into from

Conversation

jedel1043
Copy link
Member

@jedel1043 jedel1043 commented Mar 21, 2023

This Pull Request improves our test results display per edition and cleanups our edition detector logic.

It changes the following:

  • Adds a new edition flag to limit the maximum edition that will be tested.
  • Adds a new versioned flag to display all tested editions in a table.
  • Adds utility methods to SpecEdition to detect the edition of a test and get all the available editions.
  • Cleanups logic.

Output with this PR (We only collect ES5, ES6 and ES13 stats, so all other editions are a WIP):

image

Marking as a draft since I need to determine the version of the remaining features, but feel free to review everything else. Finished!

@jedel1043 jedel1043 added enhancement New feature or request test Issues and PRs related to the tests. labels Mar 21, 2023
@jedel1043 jedel1043 added this to the v0.17.0 milestone Mar 21, 2023
@codecov
Copy link

codecov bot commented Mar 21, 2023

Codecov Report

Merging #2720 (cc02c9f) into main (3b51226) will increase coverage by 1.04%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main    #2720      +/-   ##
==========================================
+ Coverage   49.14%   50.19%   +1.04%     
==========================================
  Files         400      400              
  Lines       39858    39981     +123     
==========================================
+ Hits        19590    20069     +479     
+ Misses      20268    19912     -356     
Impacted Files Coverage Δ
boa_tester/src/edition.rs 0.00% <0.00%> (ø)
boa_tester/src/exec/mod.rs 0.00% <0.00%> (ø)
boa_tester/src/main.rs 0.00% <0.00%> (ø)
boa_tester/src/read.rs 0.00% <0.00%> (ø)
boa_tester/src/results.rs 0.00% <0.00%> (ø)

... and 44 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@github-actions
Copy link

Test262 conformance changes

Test result main count PR count difference
Total 94,277 94,277 0
Passed 71,071 71,071 0
Ignored 17,324 17,324 0
Failed 5,882 5,882 0
Panics 14 14 0
Conformance 75.39% 75.39% 0.00%

Copy link
Member

@Razican Razican left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's looking great! I added some suggestions

boa_tester/src/edition.rs Show resolved Hide resolved
boa_tester/src/edition.rs Show resolved Hide resolved
boa_tester/src/edition.rs Outdated Show resolved Hide resolved
boa_tester/src/edition.rs Show resolved Hide resolved
boa_tester/src/exec/mod.rs Outdated Show resolved Hide resolved
Copy link
Member

@HalidOdat HalidOdat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

Just a small suggestion :)

boa_tester/src/main.rs Outdated Show resolved Hide resolved
Copy link
Member

@Razican Razican left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@jedel1043
Copy link
Member Author

bors r+

bors bot pushed a commit that referenced this pull request Mar 22, 2023
This Pull Request improves our test results display per edition and cleanups our edition detector logic.

It changes the following:

- Adds a new `edition` flag to limit the maximum edition that will be tested.
- Adds a new `versioned` flag to display all tested editions in a table.
- Adds utility methods to `SpecEdition` to detect the edition of a test and get all the available editions.
- Cleanups logic.

Output with this PR ~(We only collect ES5, ES6 and ES13 stats, so all other editions are a WIP)~:

![image](https://user-images.githubusercontent.com/38230983/227010384-883f0934-47be-4be7-84c2-a21feb9de8a9.png)

~Marking as a draft since I need to determine the version of the remaining features, but feel free to review everything else.~ Finished!
@bors
Copy link

bors bot commented Mar 22, 2023

Pull request successfully merged into main.

Build succeeded:

@bors bors bot changed the title Improve tester display for multiple editions [Merged by Bors] - Improve tester display for multiple editions Mar 22, 2023
@bors bors bot closed this Mar 22, 2023
@bors bors bot deleted the tester-improvements branch March 22, 2023 22:47
bors bot pushed a commit that referenced this pull request Mar 23, 2023
Small display bug introduced by #2720
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request test Issues and PRs related to the tests.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants