Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NOT FOR MERGE [test] Check runtime performance of testing-library/dom-testing-library#1068 #29368

Closed
wants to merge 1 commit into from

Conversation

eps1lon
Copy link
Member

@eps1lon eps1lon commented Oct 29, 2021

Testing testing-library/dom-testing-library#1068

Results analyzed with https://www.calculatorsoup.com/calculators/statistics/mean-median-mode.php

test:unit

master

Sampled runs

Results

test:unit runtime:

  1. 454.99s
  2. 459.60s
  3. 489.28s
  4. 358.27s
  5. 346.96s

Mean x¯¯¯ 421.82
Median x˜ 454.99
Mode 454.99, 459.60, 489.28, 358.27, 346.96
Range 142.32
Minimum 346.96
Maximum 489.28
Count n 5
Sum 2109.1
Quartiles Quartiles:
Q1 --> 352.615
Q2 --> 454.99
Q3 --> 474.44
Interquartile
Range IQR 121.825
Outliers none

PR

Sampled runs

  1. https://app.circleci.com/pipelines/github/mui-org/material-ui/54270/workflows/bdc731be-158f-4529-81de-370ee0d742f3/jobs/309905
  2. https://app.circleci.com/pipelines/github/mui-org/material-ui/54270/workflows/e5a5a49c-340d-40d7-aa0c-97aba6fbb7fa/jobs/309953
  3. https://app.circleci.com/pipelines/github/mui-org/material-ui/54270/workflows/05b02e36-d084-46b5-bf96-8037ac583a74/jobs/309960
  4. https://app.circleci.com/pipelines/github/mui-org/material-ui/54270/workflows/7789df15-414a-47af-9165-5af05b8c07ec/jobs/309964

Results

  1. 308.45s
  2. 314.55s
  3. 276.73s
  4. 387.27s

Mean x¯¯¯ 321.75
Median x˜ 311.5
Mode 308.45, 314.55, 276.73, 387.27
Range 110.54
Minimum 276.73
Maximum 387.27
Count n 4
Sum 1287
Quartiles Quartiles:
Q1 --> 292.59
Q2 --> 311.5
Q3 --> 350.91
Interquartile
Range IQR 58.32
Outliers none

test:karma

master

Sampled runs

  1. https://app.circleci.com/pipelines/github/mui-org/material-ui/54271/workflows/70b3a264-c9ff-43e4-a47e-cbdb21306595/jobs/309908
  2. https://app.circleci.com/pipelines/github/mui-org/material-ui/54267/workflows/977289f6-9d4b-4453-b8f8-782867aa6442/jobs/309878
  3. https://app.circleci.com/pipelines/github/mui-org/material-ui/54261/workflows/2bdcd6c3-1366-4db5-86c0-2dfd8a309f50/jobs/309852
  4. https://app.circleci.com/pipelines/github/mui-org/material-ui/54250/workflows/75e2d5d1-a336-47f4-a367-18ec312aaae3/jobs/309786
  5. https://app.circleci.com/pipelines/github/mui-org/material-ui/54247/workflows/d88e8629-dcf6-4291-a1f3-2004223f3488/jobs/309765

Results

  1. 89s
  2. 49s
  3. 60s
  4. 61s
  5. 52s

Mean x¯¯¯ 62.2
Median x˜ 60
Mode 89, 49, 60, 61, 52
Range 40
Minimum 49
Maximum 89
Count n 5
Sum 311
Quartiles Quartiles:
Q1 --> 50.5
Q2 --> 60
Q3 --> 75
Interquartile
Range IQR 24.5
Outliers none

PR

Sampled runs

  1. https://app.circleci.com/pipelines/github/mui-org/material-ui/54270/workflows/bdc731be-158f-4529-81de-370ee0d742f3/jobs/309906
  2. https://app.circleci.com/pipelines/github/mui-org/material-ui/54270/workflows/e5a5a49c-340d-40d7-aa0c-97aba6fbb7fa/jobs/309952
  3. https://app.circleci.com/pipelines/github/mui-org/material-ui/54270/workflows/05b02e36-d084-46b5-bf96-8037ac583a74/jobs/309962
  4. https://app.circleci.com/pipelines/github/mui-org/material-ui/54270/workflows/7789df15-414a-47af-9165-5af05b8c07ec/jobs/309968

Results

  1. 61s
  2. 53s
  3. 84s
  4. 63s

Mean x¯¯¯ 65.25
Median x˜ 62
Mode 61, 53, 84, 63
Range 31
Minimum 53
Maximum 84
Count n 4
Sum 261
Quartiles Quartiles:
Q1 --> 57
Q2 --> 62
Q3 --> 73.5
Interquartile
Range IQR 16.5
Outliers none

Conclusion

While it's hard to tell if this change does in fact speed things up (ressource classes are flaky; wide spread to begin with) it seems safe to say that this didn't result in a significant slowdown.

Looks safe to land.

@mui-pr-bot
Copy link

mui-pr-bot commented Oct 29, 2021

No bundle size changes

Generated by 🚫 dangerJS against 2d8e0da

@eps1lon eps1lon closed this Oct 29, 2021
@eps1lon eps1lon deleted the test/dlt-1068 branch October 29, 2021 12:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants