Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Update Integration Test Performance Data #5785

Merged
merged 1 commit into from
Jun 20, 2024
Merged

Conversation

street-side-software-automation[bot]
Copy link
Contributor

Update Integration Test Performance Data

Integration Tests Summary

  • ref: "refs/heads/main"
  • runs_on: "ubuntu-latest"
  • node_version: 18.x
  • branch: main

Performance Report

Repository Elapsed Min/Avg/Max SD SD Graph
AdaDoom3/AdaDoom3 12.46 11.9 / 12.3 / 13.9 0.36 ┣━━┻━━╋●━┻━━┫
alexiosc/megistos 30.73 29.5 / 31.2 / 33.0 0.83 ┣━━┻●━╋━━┻━━┫
apollographql/apollo-server 6.85 6.4 / 6.8 / 7.0 0.17 ┣━┻━━╋━●┻━┫
aspnetboilerplate/aspnetboilerplate 26.13 23.3 / 24.7 / 26.4 0.73 ┣━━┻━━╋━━┻━━●
aws-amplify/docs 36.76 35.3 / 37.8 / 61.0 4.30 ┣━━━┻━●╋━━┻━━━┫
Azure/azure-rest-api-specs 32.71 30.1 / 32.1 / 34.3 1.11 ┣━━┻━━╋━●┻━━┫
bitjson/typescript-starter 0.86 0.8 / 0.9 / 1.1 0.05 ┣━━┻●╋━┻━━┫
caddyserver/caddy 12.02 11.2 / 11.8 / 12.6 0.33 ┣━━┻━━╋━●┻━━┫
canada-ca/open-source-logiciel-libre 1.01 0.9 / 1.0 / 1.1 0.03 ┣━━┻━╋●┻━━┫
chef/chef 20.84 19.8 / 20.7 / 21.8 0.57 ┣━━┻━━╋●━┻━━┫
django/django 53.60 50.2 / 52.7 / 55.5 1.19 ┣━━━┻━━╋━●┻━━━┫
eslint/eslint 31.37 29.7 / 31.8 / 33.7 0.94 ┣━━┻━●╋━━┻━━┫
exonum/exonum 11.75 11.3 / 11.7 / 12.3 0.25 ┣━━┻━━●━━┻━━┫
gitbucket/gitbucket 7.35 6.7 / 7.0 / 7.5 0.22 ┣━━┻━━╋━━┻━●┫
googleapis/google-cloud-cpp 418.96 378.1 / 393.1 / 419.4 9.75 ┣━━━┻━━━╋━━━┻━━━┫ ●
graphql/express-graphql 0.93 0.9 / 0.9 / 1.0 0.03 ┣━━┻━●━┻━━┫
graphql/graphql-js 6.02 5.7 / 6.0 / 6.6 0.17 ┣━┻━━●━━┻━┫
graphql/graphql-relay-js 0.96 0.9 / 0.9 / 1.1 0.05 ┣━━┻━╋●┻━━┫
graphql/graphql-spec 1.98 1.8 / 1.9 / 2.0 0.05 ┣━━┻━╋━┻━●┫
iluwatar/java-design-patterns 33.62 31.1 / 33.1 / 36.2 1.19 ┣━━┻━━╋●━┻━━┫
ktaranov/sqlserver-kit 23.28 22.1 / 23.3 / 25.3 0.64 ┣━━┻━━●━━┻━━┫
liriliri/licia 7.58 7.5 / 8.0 / 8.7 0.30 ┣━●┻━━╋━━┻━━┫
MartinThoma/LaTeX-examples 14.07 13.3 / 14.1 / 15.2 0.43 ┣━━┻━━●━━┻━━┫
mdx-js/mdx 3.99 3.7 / 3.8 / 4.1 0.11 ┣━┻━━╋━━┻●┫
microsoft/TypeScript-Website 17.98 17.2 / 18.6 / 20.6 0.94 ┣━━┻●━╋━━┻━━┫
MicrosoftDocs/PowerShell-Docs 90.73 85.0 / 89.2 / 94.4 2.09 ┣━━━┻━━╋━━●━━━┫
neovim/nvim-lspconfig 8.98 8.6 / 9.1 / 9.7 0.23 ┣━━┻━●╋━━┻━━┫
pagekit/pagekit 7.86 7.3 / 7.7 / 8.3 0.23 ┣━━┻━━╋━●┻━━┫
php/php-src 111.05 110.9 / 116.4 / 139.3 4.91 ┣━━●━━━╋━━━┻━━┫
plasticrake/tplink-smarthome-api 1.53 1.5 / 1.5 / 1.7 0.06 ┣━━┻●╋━┻━━┫
prettier/prettier 14.18 12.8 / 13.4 / 14.0 0.31 ┣━━┻━━╋━━┻━━┫●
pycontribs/jira 2.74 2.5 / 2.7 / 3.1 0.11 ┣━┻━━╋●━┻━┫
RustPython/RustPython 15.01 13.9 / 14.5 / 15.9 0.42 ┣━━┻━━╋━━┻●━┫
shoelace-style/shoelace 7.27 7.1 / 7.5 / 8.5 0.31 ┣━━┻●━╋━━┻━━┫
SoftwareBrothers/admin-bro 4.45 4.5 / 4.7 / 5.0 0.13 ┣●┻━━╋━━┻━┫
sveltejs/svelte 38.68 36.6 / 37.9 / 39.5 0.79 ┣━━┻━━╋━━●━━┫
TheAlgorithms/Python 17.87 16.2 / 17.0 / 18.1 0.42 ┣━━┻━━╋━━┻━━●
twbs/bootstrap 3.68 3.6 / 3.7 / 4.0 0.11 ┣━┻━●╋━━┻━┫
typescript-cheatsheets/react 2.29 2.0 / 2.1 / 2.3 0.07 ┣━┻━━╋━━┻━┫●
typescript-eslint/typescript-eslint 6.75 6.3 / 6.7 / 7.5 0.27 ┣━━┻━━╋●━┻━━┫
w3c/aria-practices 9.63 9.2 / 9.7 / 10.5 0.32 ┣━━┻━●╋━━┻━━┫
w3c/specberus 3.14 2.8 / 3.0 / 3.3 0.10 ┣━┻━━╋━━┻━●
webdeveric/webpack-assets-manifest 0.86 0.8 / 0.8 / 1.0 0.04 ┣━━┻━╋●┻━━┫
webpack/webpack 12.84 11.5 / 12.2 / 13.0 0.33 ┣━━┻━━╋━━┻━●┫
wireapp/wire-desktop 1.33 1.3 / 1.4 / 1.6 0.07 ┣━━┻●╋━┻━━┫
wireapp/wire-webapp 22.64 19.5 / 21.5 / 22.7 0.62 ┣━━┻━━╋━━┻━━●
Repository Elapsed Rel Trend Count
AdaDoom3/AdaDoom3 12.46 1.34% ▃▃▄▅▃▃▂▄▄▃▂▃▄▃▅▆▄▄▅▄ 31
alexiosc/megistos 30.73 -1.55% ▄▃▂▃▄▄▂▄▃▄▄ ▂▃▅▅▅▁▃▃ 31
apollographql/apollo-server 6.85 1.48% ▂▅▅▁▂▅▅▃▃▄▆▃▃▆▅▃▃▃▆▅ 31
aspnetboilerplate/aspnetboilerplate 26.13 5.96% ▅▃▃▂▃▆▆▃▃▆▃▃▄▃▄▆▃▅█▇ 32
aws-amplify/docs 36.76 -2.67% ▃▃▄▃▃▃▃▃▃▃▃▃▃▃▃▄▄▄█▃ 32
Azure/azure-rest-api-specs 32.71 2.03% ▃▆▃▄▅▅▃▃▅▁▅▃▅▆▅▄▄▃▂▅ 32
bitjson/typescript-starter 0.86 -1.84% ▅▃▃▃▃▂▄▂▇▄▃▄▄▃▄▂▃▄▃▃ 31
caddyserver/caddy 12.02 2.22% ▁▃▂▂▅▆▃▂▂▃▆▄▄▄▄▄▆▄▅▅ 32
canada-ca/open-source-logiciel-libre 1.01 1.70% ▃▂▇▅▄▃▃▃▄▂▅▂▃ ▄▃▅▄▄▅ 31
chef/chef 20.84 0.75% ▃▃▃▃▂▃▂▂▁▄▂▃▄▇▃▃▄▇▃▄ 32
django/django 53.60 1.64% ▃▄▅▂▃▅▃▄▂▄▄▃▇▆▃▄▆▃▃▅ 32
eslint/eslint 31.37 -1.23% ▂▂▃▂▂▇▅▃▅▄▄▄▂▆▄▄▇▂▃▃ 32
exonum/exonum 11.75 0.05% ▂▃▇▃▂▄▂▃▄▄▇▃▁▂▄▃▂▆▃▄ 31
gitbucket/gitbucket 7.35 5.20% ▁▆▆▁▄▃▅▃▅▄▂▂▇▃▅▄▄▂▄▆ 32
googleapis/google-cloud-cpp 418.96 6.58% ▂▂▄▄▅▃▂▅▇▄▂▄▃▄▅▅█▂▄█ 34
graphql/express-graphql 0.93 0.49% █▄▂▅▂▄▂▄▂▂▄▂▃▂▄▆▄▄▃▄ 31
graphql/graphql-js 6.02 0.26% ▂▂▅▂▂▄▄█▄▅▄▄▂▂▂▃▃▃▄▄ 32
graphql/graphql-relay-js 0.96 1.98% ▃▃▃▅▃▄▃▃▂▃▃▂▂▂▃▅█▄▃▄ 31
graphql/graphql-spec 1.98 4.16% ▂▂▃▂▂▂▇▃▃▄▄▅▃▅▅▂▇▂▃▆ 32
iluwatar/java-design-patterns 33.62 1.53% ▂▄█▄▄▄▄▃▄▅▄▅▅▃▇▄▅▇▅▄ 32
ktaranov/sqlserver-kit 23.28 -0.16% ▃▆▄▅█▄▄▁▃▁▄▄▅▄▄▇▃▃▄▄ 31
liriliri/licia 7.58 -5.47% ▃▂▃▂▃▅▂▄▄▄▆▇▄▂▆▇▅▁▄▁ 32
MartinThoma/LaTeX-examples 14.07 -0.01% ▂▃▄▇▂▃▃▃▄▂▄▆▄▆▅▃▅▅▅▄ 31
mdx-js/mdx 3.99 3.94% ▂▇▄▁▃▅▅▂▄▅▅▅▃▄▅▂▃▆▂▆ 31
microsoft/TypeScript-Website 17.98 -3.22% ▅▅▆▆▅▅▃▂▂▃▃▃▂▃▃▂▂▂▃▃ 32
MicrosoftDocs/PowerShell-Docs 90.73 1.75% ▄▁▅▃▄▆▂▃▄▄▃▁█▂▄▄▆▃▇▅ 32
neovim/nvim-lspconfig 8.98 -0.97% ▄▂▂▃▄▆▅▄▅▅▄▅▃▅▄▂▄▃▄▃ 32
pagekit/pagekit 7.86 2.47% ▂▃▄▂▂▃█▃▄▂▄▄▂▄▂▃▅▁▅▅ 31
php/php-src 111.05 -4.61% ▂▃▂▅▄▂▃▃▂█▂▃▄▄▄▄▄▃▂▂ 33
plasticrake/tplink-smarthome-api 1.53 -0.84% ▂▃▂▅▂▃▃▂▅▅▄▂█▄▄▄▄▃▅▃ 31
prettier/prettier 14.18 5.76% ▁▃▃▁▃▂▆▅▇▁▅▃▃▅▂▅▄▅▆█ 32
pycontribs/jira 2.74 2.26% ▃▂▅▅▆▄▄▄▄▄▃▂▃▃▄▃█▃▃▅ 31
RustPython/RustPython 15.01 3.47% ▃▆▃▃▅▂▃▅▄▃▂▂▅▅▃▃▃▆▂▆ 32
shoelace-style/shoelace 7.27 -2.41% ▅▂▃█▄▃▇▄▃▄▃▂▃▂▂▃▃▂▃▃ 32
SoftwareBrothers/admin-bro 4.45 -4.70% ▆▄▂▂▁▃▃▃▄▃▅▃▃▇▃▆▃▆▂▁ 31
sveltejs/svelte 38.68 1.97% ▃▄▇▄▆▄▃▅▅▂▃▅▄▃▇▄▃▄▂▅ 32
TheAlgorithms/Python 17.87 5.22% ▄▃▃▁▅▄▄▅▂▃▂▅▄▄▆█▃▃▆▇ 32
twbs/bootstrap 3.68 -1.15% ▅▂▇▃▂▄▅▄▃▃▆▁▁▇▄▅▄▅▂▃ 32
typescript-cheatsheets/react 2.29 7.61% ▁▃▄▄▂▅▃▃▂▂▇▄▅▄▃▂▄▄▅█ 31
typescript-eslint/typescript-eslint 6.75 0.93% ▃▃▂▅▇▅▅▄▄▄▄▄▃▃▃▃▃▃▂▄ 32
w3c/aria-practices 9.63 -1.05% ▂▅▁▂▆▇▂▄▄▃▄▂▂▃▃▅▄▄▂▃ 31
w3c/specberus 3.14 5.90% ▃▄▂▃▅▅█▄▂▄▂▂▄▄▂▃▅▃▃▇ 32
webdeveric/webpack-assets-manifest 0.86 1.71% ▃█▃▅▃▃▃▃▄▃▄▃▃▃▃▃▄▄▃▄ 31
webpack/webpack 12.84 4.97% ▇▂▃▃▅▅▄▂▂▃▃▂▆▂▃▄▇▅▅▇ 32
wireapp/wire-desktop 1.33 -2.56% ▇▂▃▃▂▂▅▃▃▃▃▃▄▃▄▃▄▃▄▃ 32
wireapp/wire-webapp 22.64 5.44% ▆▄▄▃▆▅▂▃▃▄▆▄▂▃▄▄▅▄▆▇ 32

Note:

  • Elapsed time is in seconds. The trend graph shows the last 10 runs.
    The SD graph shows the current run relative to the average and standard deviation.
  • Rel is the relative change from the average.

Selected Diffs

diff --git a/integration-tests/perf/perf.csv b/integration-tests/perf/perf.csv
index 555f957..290a366 100644
--- a/integration-tests/perf/perf.csv
+++ b/integration-tests/perf/perf.csv
@@ -6172,3 +6172,49 @@ timestamp,repo,elapsedMs,files,filesWithIssues,issues,errors,platform,usageUser,
 1718893961063,MicrosoftDocs/PowerShell-Docs,92884.971999,2683,1238,5412,0,linux,118096.666,4941.178
 1718893980251,php/php-src,112385.51464500002,2173,1644,43382,0,linux,137973.71,6181.767
 1718894264885,googleapis/google-cloud-cpp,394933.13759800006,19129,11616,90368,0,linux,479078.993,20036.868
+1718899552272,canada-ca/open-source-logiciel-libre,1014.8697549999924,7,0,0,0,linux,1740.411,55.13
+1718899555814,graphql/graphql-js,6024.326123000006,367,0,0,0,linux,8469.082,417.227
+1718899556979,gitbucket/gitbucket,7348.471839000005,411,396,2062,0,linux,9986.918,619.187
+1718899557175,apollographql/apollo-server,6850.615485999995,245,1,1,0,linux,9021.764,486.535
+1718899561198,exonum/exonum,11748.003917999973,421,3,7,0,linux,15172.933,778.687
+1718899561235,graphql/graphql-relay-js,957.5383290000027,28,2,3,0,linux,1617.683,36.063
+1718899563290,bitjson/typescript-starter,860.8064619999786,20,0,0,0,linux,1393.673,77.357
+1718899570145,caddyserver/caddy,12016.54445700001,274,255,4070,0,linux,15560.623,754.475
+1718899571933,AdaDoom3/AdaDoom3,12463.97112099998,103,98,3226,0,linux,16090.395,674.087
+1718899577375,aspnetboilerplate/aspnetboilerplate,26125.343096999975,2733,856,2853,0,linux,32952.301,1379.398
+1718899579600,graphql/graphql-spec,1980.9015959999815,15,3,146,0,linux,2999.429,187.909
+1718899580094,chef/chef,20840.606494999985,1179,4,17,0,linux,27018.046,1278.539
+1718899586583,eslint/eslint,31371.81495499998,1940,324,1730,0,linux,41007.805,1864.748
+1718899587182,alexiosc/megistos,30732.61938599999,583,578,47344,0,linux,37690.226,1871.984
+1718899587969,graphql/express-graphql,931.7404099999985,26,0,0,0,linux,1498.388,75.358
+1718899598098,aws-amplify/docs,36755.12066700001,2825,1,4,0,linux,46125.497,2265.702
+1718899598916,mdx-js/mdx,3993.908454999997,144,89,988,0,linux,5596.27,301.784
+1718899599649,liriliri/licia,7578.925564000005,1413,84,361,0,linux,10202.425,619.729
+1718899599789,pagekit/pagekit,7859.635571000021,741,211,637,0,linux,10437.206,501.164
+1718899600655,pycontribs/jira,2739.0674270000018,78,40,562,0,linux,3941.688,215.763
+1718899601940,MartinThoma/LaTeX-examples,14069.77763299999,1407,481,4796,0,linux,17829.728,1037.207
+1718899603451,plasticrake/tplink-smarthome-api,1531.8949560000037,62,1,2,0,linux,2374.74,99.535
+1718899605124,Azure/azure-rest-api-specs,32709.591591000033,2363,843,2938,0,linux,40188.862,2004.998
+1718899606056,ktaranov/sqlserver-kit,23278.794636000006,489,452,14344,0,linux,29513.55,1166.324
+1718899606768,microsoft/TypeScript-Website,17975.447824000003,751,170,725,0,linux,22545.631,1234.38
+1718899609877,shoelace-style/shoelace,7270.739811000007,436,14,46,0,linux,9866.45,515.349
+1718899611719,twbs/bootstrap,3683.51215699999,120,0,0,0,linux,5051.063,289.796
+1718899613361,django/django,53598.857124,2789,900,7993,0,linux,67497.671,3052.433
+1718899614378,iluwatar/java-design-patterns,33624.85429999998,1823,1806,11172,0,linux,42378.817,2061.42
+1718899615469,webdeveric/webpack-assets-manifest,856.8991910000041,19,0,0,0,linux,1460.293,76.598
+1718899615850,w3c/specberus,3140.6716089999827,200,0,0,0,linux,4512.192,285.785
+1718899618163,SoftwareBrothers/admin-bro,4450.083143999989,440,25,56,0,linux,6057.406,343.646
+1718899618597,typescript-cheatsheets/react,2288.594469999982,53,42,413,0,linux,3282.236,200.821
+1718899624139,w3c/aria-practices,9626.57217,397,0,0,0,linux,12783.083,737.469
+1718899627739,RustPython/RustPython,15013.284830999997,611,316,2918,0,linux,19525.68,1100.119
+1718899629330,typescript-eslint/typescript-eslint,6745.185972000007,1235,0,0,0,linux,8951.577,667.904
+1718899632764,wireapp/wire-desktop,1325.2906039999798,42,5,23,0,linux,1963.435,153.367
+1718899633003,TheAlgorithms/Python,17870.214565000002,1334,489,3313,0,linux,22999,1168.141
+1718899639529,neovim/nvim-lspconfig,8980.82260699998,343,339,4451,0,linux,11448.105,515.248
+1718899643166,webpack/webpack,12843.786042000022,1084,0,0,0,linux,16682.21,983.479
+1718899650300,prettier/prettier,14182.16782100004,2173,1,1,0,linux,18550.042,1035.05
+1718899661646,wireapp/wire-webapp,22639.606918999983,1173,636,2757,0,linux,29049.107,1156.141
+1718899677481,MicrosoftDocs/PowerShell-Docs,90729.983056,2683,1238,5412,0,linux,113716.3,4875.254
+1718899691787,sveltejs/svelte,38677.116025000025,6713,637,5316,0,linux,46803.226,2309.131
+1718899746361,php/php-src,111049.830517,2173,1644,43382,0,linux,138065.397,6129.274
+1718899999290,googleapis/google-cloud-cpp,418958.785131,19129,11616,90368,0,linux,512477.135,21219.991

Summary

 integration-tests/perf/perf.csv | 46 +++++++++++++++++++++++++++++++++++++++++
 1 file changed, 46 insertions(+)

@github-actions github-actions bot added the chore label Jun 20, 2024
@Jason3S Jason3S merged commit ed1de0e into main Jun 20, 2024
11 checks passed
@Jason3S Jason3S deleted the update-perf-main branch June 20, 2024 17:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant