Skip to content

refactor: use CI runer to run benchmark #10689

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from

Conversation

stormslowly
Copy link
Contributor

Summary

Checklist

  • Tests updated (or not required).
  • Documentation updated (or not required).

Copy link

netlify bot commented Jun 16, 2025

Deploy Preview for rspack canceled.

Name Link
🔨 Latest commit efbd5f0
🔍 Latest deploy log https://app.netlify.com/projects/rspack/deploys/6850a6db2f2b9000089caf32

@github-actions github-actions bot added team The issue/pr is created by the member of Rspack. release: refactor labels Jun 16, 2025
Copy link

codspeed-hq bot commented Jun 16, 2025

CodSpeed Performance Report

Merging #10689 will not alter performance

Comparing ci/run_bencha_on_selfhosted (efbd5f0) with main (d520fea)

🎉 Hooray! codspeed-node just leveled up to 4.0.1!

A heads-up, this is a breaking change and it might affect your current performance baseline a bit. But here's the exciting part - it's packed with new, cool features and promises improved result stability 🥳!
Curious about what's new? Visit our releases page to delve into all the awesome details about this new version.

Summary

✅ 12 untouched benchmarks

Copy link
Contributor

github-actions bot commented Jun 16, 2025

📝 Benchmark detail: Open

Name Base (2025-06-16 b632718) Current Change
10000_big_production-mode_disable-minimize + exec 35.2 s ± 1.2 s 24.6 s ± 290 ms -30.09 %
10000_development-mode + exec 1.81 s ± 26 ms 1.55 s ± 59 ms -14.42 %
10000_development-mode_hmr + exec 690 ms ± 11 ms 715 ms ± 21 ms +3.62 %
10000_production-mode + exec 2.2 s ± 23 ms 2.21 s ± 29 ms +0.13 %
10000_production-mode_persistent-cold + exec 2.38 s ± 60 ms 2.34 s ± 43 ms -1.52 %
10000_production-mode_persistent-hot + exec 1.65 s ± 61 ms 1.67 s ± 41 ms +1.29 %
arco-pro_development-mode + exec 1.78 s ± 100 ms 1.53 s ± 35 ms -14.14 %
arco-pro_development-mode_hmr + exec 369 ms ± 1 ms 376 ms ± 2.3 ms +1.86 %
arco-pro_production-mode + exec 3.31 s ± 110 ms 2.93 s ± 38 ms -11.57 %
arco-pro_production-mode_generate-package-json-webpack-plugin + exec 3.38 s ± 87 ms 3.04 s ± 35 ms -9.88 %
arco-pro_production-mode_persistent-cold + exec 3.35 s ± 138 ms 3.02 s ± 102 ms -9.95 %
arco-pro_production-mode_persistent-hot + exec 2.05 s ± 64 ms 1.93 s ± 37 ms -5.59 %
arco-pro_production-mode_traverse-chunk-modules + exec 3.35 s ± 29 ms 2.96 s ± 41 ms -11.68 %
large-dyn-imports_development-mode + exec 2.02 s ± 37 ms 1.76 s ± 39 ms -13.01 %
large-dyn-imports_production-mode + exec 2.04 s ± 42 ms 1.9 s ± 161 ms -6.82 %
threejs_development-mode_10x + exec 1.42 s ± 22 ms 1.31 s ± 32 ms -8.16 %
threejs_development-mode_10x_hmr + exec 808 ms ± 15 ms 832 ms ± 5.9 ms +2.98 %
threejs_production-mode_10x + exec 4.7 s ± 78 ms 4.6 s ± 73 ms -2.33 %
threejs_production-mode_10x_persistent-cold + exec 4.89 s ± 165 ms 4.73 s ± 61 ms -3.31 %
threejs_production-mode_10x_persistent-hot + exec 4.1 s ± 35 ms 4.11 s ± 55 ms +0.16 %
10000_big_production-mode_disable-minimize + rss memory 9277 MiB ± 71.6 MiB 10674 MiB ± 247 MiB +15.05 %
10000_development-mode + rss memory 741 MiB ± 36.3 MiB 750 MiB ± 58.6 MiB +1.31 %
10000_development-mode_hmr + rss memory 853 MiB ± 46.1 MiB 857 MiB ± 28.9 MiB +0.52 %
10000_production-mode + rss memory 729 MiB ± 51 MiB 756 MiB ± 34.1 MiB +3.75 %
10000_production-mode_persistent-cold + rss memory 874 MiB ± 39 MiB 885 MiB ± 50.6 MiB +1.34 %
10000_production-mode_persistent-hot + rss memory 886 MiB ± 46.2 MiB 863 MiB ± 40.9 MiB -2.62 %
arco-pro_development-mode + rss memory 661 MiB ± 61 MiB 694 MiB ± 50.4 MiB +4.88 %
arco-pro_development-mode_hmr + rss memory 571 MiB ± 60.5 MiB 564 MiB ± 67.1 MiB -1.19 %
arco-pro_production-mode + rss memory 785 MiB ± 76.6 MiB 778 MiB ± 125 MiB -0.88 %
arco-pro_production-mode_generate-package-json-webpack-plugin + rss memory 783 MiB ± 25.6 MiB 793 MiB ± 88 MiB +1.31 %
arco-pro_production-mode_persistent-cold + rss memory 956 MiB ± 183 MiB 933 MiB ± 103 MiB -2.47 %
arco-pro_production-mode_persistent-hot + rss memory 766 MiB ± 128 MiB 803 MiB ± 115 MiB +4.82 %
arco-pro_production-mode_traverse-chunk-modules + rss memory 773 MiB ± 48.6 MiB 774 MiB ± 73.1 MiB +0.10 %
large-dyn-imports_development-mode + rss memory 750 MiB ± 12.8 MiB 750 MiB ± 11.7 MiB -0.04 %
large-dyn-imports_production-mode + rss memory 614 MiB ± 13.1 MiB 609 MiB ± 15.6 MiB -0.85 %
threejs_development-mode_10x + rss memory 822 MiB ± 91 MiB 792 MiB ± 39.1 MiB -3.65 %
threejs_development-mode_10x_hmr + rss memory 944 MiB ± 150 MiB 919 MiB ± 45.7 MiB -2.63 %
threejs_production-mode_10x + rss memory 1073 MiB ± 66.2 MiB 1074 MiB ± 88.4 MiB +0.05 %
threejs_production-mode_10x_persistent-cold + rss memory 1161 MiB ± 70.1 MiB 1163 MiB ± 74.8 MiB +0.18 %
threejs_production-mode_10x_persistent-hot + rss memory 952 MiB ± 34.8 MiB 938 MiB ± 27.3 MiB -1.43 %

@web-infra-dev web-infra-dev deleted a comment from github-actions bot Jun 16, 2025
Copy link
Contributor

github-actions bot commented Jun 16, 2025

📝 Benchmark detail: Open

Name Base (2025-06-16 b632718) Current Change
10000_big_production-mode_disable-minimize + exec 35.2 s ± 1.2 s 24.5 s ± 349 ms -30.34 %
10000_development-mode + exec 1.81 s ± 26 ms 1.55 s ± 14 ms -14.32 %
10000_development-mode_hmr + exec 690 ms ± 11 ms 721 ms ± 20 ms +4.51 %
10000_production-mode + exec 2.2 s ± 23 ms 2.2 s ± 48 ms +0.02 %
10000_production-mode_persistent-cold + exec 2.38 s ± 60 ms 2.36 s ± 24 ms -0.66 %
10000_production-mode_persistent-hot + exec 1.65 s ± 61 ms 1.66 s ± 34 ms +0.55 %
arco-pro_development-mode + exec 1.78 s ± 100 ms 1.52 s ± 41 ms -14.72 %
arco-pro_development-mode_hmr + exec 369 ms ± 1 ms 376 ms ± 1.3 ms +1.76 %
arco-pro_production-mode + exec 3.31 s ± 110 ms 2.95 s ± 60 ms -10.96 %
arco-pro_production-mode_generate-package-json-webpack-plugin + exec 3.38 s ± 87 ms 3.03 s ± 59 ms -10.20 %
arco-pro_production-mode_persistent-cold + exec 3.35 s ± 138 ms 3.02 s ± 64 ms -10.07 %
arco-pro_production-mode_persistent-hot + exec 2.05 s ± 64 ms 1.92 s ± 67 ms -6.03 %
arco-pro_production-mode_traverse-chunk-modules + exec 3.35 s ± 29 ms 2.96 s ± 26 ms -11.43 %
large-dyn-imports_development-mode + exec 2.02 s ± 37 ms 1.76 s ± 70 ms -13.23 %
large-dyn-imports_production-mode + exec 2.04 s ± 42 ms 1.86 s ± 151 ms -8.82 %
threejs_development-mode_10x + exec 1.42 s ± 22 ms 1.3 s ± 12 ms -8.49 %
threejs_development-mode_10x_hmr + exec 808 ms ± 15 ms 834 ms ± 6.8 ms +3.31 %
threejs_production-mode_10x + exec 4.7 s ± 78 ms 4.59 s ± 116 ms -2.50 %
threejs_production-mode_10x_persistent-cold + exec 4.89 s ± 165 ms 4.72 s ± 62 ms -3.66 %
threejs_production-mode_10x_persistent-hot + exec 4.1 s ± 35 ms 4.09 s ± 66 ms -0.33 %
10000_big_production-mode_disable-minimize + rss memory 9277 MiB ± 71.6 MiB 10716 MiB ± 186 MiB +15.51 %
10000_development-mode + rss memory 741 MiB ± 36.3 MiB 771 MiB ± 41.5 MiB +4.09 %
10000_development-mode_hmr + rss memory 853 MiB ± 46.1 MiB 859 MiB ± 39 MiB +0.79 %
10000_production-mode + rss memory 729 MiB ± 51 MiB 766 MiB ± 53.3 MiB +5.09 %
10000_production-mode_persistent-cold + rss memory 874 MiB ± 39 MiB 903 MiB ± 36.7 MiB +3.33 %
10000_production-mode_persistent-hot + rss memory 886 MiB ± 46.2 MiB 871 MiB ± 27 MiB -1.63 %
arco-pro_development-mode + rss memory 661 MiB ± 61 MiB 709 MiB ± 83.2 MiB +7.24 %
arco-pro_development-mode_hmr + rss memory 571 MiB ± 60.5 MiB 602 MiB ± 70.2 MiB +5.37 %
arco-pro_production-mode + rss memory 785 MiB ± 76.6 MiB 774 MiB ± 77.8 MiB -1.41 %
arco-pro_production-mode_generate-package-json-webpack-plugin + rss memory 783 MiB ± 25.6 MiB 797 MiB ± 112 MiB +1.78 %
arco-pro_production-mode_persistent-cold + rss memory 956 MiB ± 183 MiB 933 MiB ± 137 MiB -2.44 %
arco-pro_production-mode_persistent-hot + rss memory 766 MiB ± 128 MiB 797 MiB ± 84.7 MiB +4.04 %
arco-pro_production-mode_traverse-chunk-modules + rss memory 773 MiB ± 48.6 MiB 777 MiB ± 70.5 MiB +0.49 %
large-dyn-imports_development-mode + rss memory 750 MiB ± 12.8 MiB 750 MiB ± 21.9 MiB -0.01 %
large-dyn-imports_production-mode + rss memory 614 MiB ± 13.1 MiB 604 MiB ± 5.17 MiB -1.63 %
threejs_development-mode_10x + rss memory 822 MiB ± 91 MiB 798 MiB ± 28 MiB -2.98 %
threejs_development-mode_10x_hmr + rss memory 944 MiB ± 150 MiB 926 MiB ± 57.2 MiB -1.87 %
threejs_production-mode_10x + rss memory 1073 MiB ± 66.2 MiB 1039 MiB ± 47.1 MiB -3.20 %
threejs_production-mode_10x_persistent-cold + rss memory 1161 MiB ± 70.1 MiB 1166 MiB ± 43.7 MiB +0.43 %
threejs_production-mode_10x_persistent-hot + rss memory 952 MiB ± 34.8 MiB 953 MiB ± 25.9 MiB +0.08 %

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release: refactor team The issue/pr is created by the member of Rspack.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant