Skip to content

feat(ci): 스모크 테스트 결과 PR 댓글로 포스트#303

Merged
ohah merged 3 commits intomainfrom
feat/smoke-ci-comment
Mar 23, 2026
Merged

feat(ci): 스모크 테스트 결과 PR 댓글로 포스트#303
ohah merged 3 commits intomainfrom
feat/smoke-ci-comment

Conversation

@ohah
Copy link
Copy Markdown
Owner

@ohah ohah commented Mar 23, 2026

Summary

  • PR에서 스모크 테스트 실행 후 결과 테이블을 PR 댓글로 자동 생성/업데이트
  • 패키지별 크기, 시간, esbuild 비교가 포함된 마크다운 테이블

Test plan

  • integration.yml 문법 검증
  • benchmark.yml과 동일한 댓글 패턴 (peter-evans/find-comment + create-or-update-comment)

🤖 Generated with Claude Code

PR에서 스모크 테스트 실행 후 결과 테이블(패키지별 크기, 시간, esbuild 비교)을
PR 댓글로 자동 생성/업데이트.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@ohah ohah added the enhancement New feature or request label Mar 23, 2026
@ohah ohah self-assigned this Mar 23, 2026
esbuild만 minify하면 크기 비교가 불공정. ZTS도 minify 없이 실행하므로
esbuild도 동일 조건으로 비교.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 23, 2026

Smoke Test Results (CI)

Smoke Test Results

Project ZTS Size Time esbuild Size Time rolldown Size Time
lodash-es OK 50KB 56ms OK 65KB 53ms OK 100KB 171ms
preact OK 13KB 3ms OK 15KB 8ms OK 13KB 110ms
date-fns OK 38KB 26ms OK 47KB 38ms OK 78KB 134ms
uuid OK 3KB 3ms OK 2KB 8ms OK 2KB 116ms
zod OK 413KB 66ms OK 507KB 31ms OK 90KB 135ms
axios OK 350KB 35ms OK 415KB 29ms OK 377KB 146ms
toolkit OK 141KB 13ms OK 51KB 17ms OK 39KB 129ms
rxjs OK 43KB 29ms OK 371KB 37ms OK 309KB 151ms
immer OK 40KB 5ms OK 26KB 9ms OK 23KB 113ms
superjson OK 22KB 6ms OK 26KB 11ms OK 24KB 116ms
express OK 778KB 67ms OK 1127KB 41ms OK 880KB 171ms
react OK 51KB 5ms OK 64KB 9ms OK 54KB 265ms
commander OK 69KB 8ms OK 124KB 12ms OK 104KB 114ms
eventemitter3 OK 6KB 2ms OK 8KB 7ms OK 9KB 111ms
ms OK 3KB 2ms OK 4KB 6ms OK 4KB 115ms
dotenv OK 13KB 3ms OK 16KB 7ms OK 13KB 111ms
jsonwebtoken OK 113KB 22ms OK 139KB 17ms OK 142KB 126ms
bcryptjs OK 27KB 4ms OK 32KB 8ms OK 37KB 114ms
clsx OK 1KB 2ms OK 1KB 6ms OK 1KB 112ms
tiny-invariant OK 0KB 1ms OK 1KB 6ms OK 1KB 117ms
tanstack-query OK 77KB 10ms OK 57KB 12ms OK 49KB 118ms
fast-glob OK 155KB 25ms OK 193KB 19ms OK 182KB 128ms
micromatch OK 73KB 10ms OK 93KB 11ms OK 94KB 126ms
semver OK 53KB 13ms OK 67KB 11ms OK 52KB 118ms
debug OK 14KB 4ms OK 20KB 7ms OK 20KB 116ms
chalk OK 10KB 3ms OK 16KB 8ms OK 14KB 116ms
yaml OK 163KB 23ms OK 262KB 20ms OK 228KB 133ms
yargs OK 198KB 20ms OK 222KB 18ms OK 202KB 133ms
effect OK 679KB 357ms OK 477KB 160ms OK 368KB 280ms

29/29 projects built successfully.

Auto-generated by CI on 2026-03-23 13:34 UTC

@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 23, 2026

Benchmark Results (CI)

macos-latest

transpile — small (100 lines)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 3 2 3 1.0x
esbuild 5 5 6 1.7x
Bun 7 6 8 2.3x
oxc (node) 69 63 74 23.0x
SWC 140 127 166 46.7x

transpile — medium (1K lines)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 4 4 4 1.0x
esbuild 6 5 8 1.5x
Bun 11 7 16 2.8x
oxc (node) 70 61 79 17.5x
SWC 126 120 130 31.5x

transpile — large (5K lines)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
esbuild 8 6 10 1.0x
Bun 10 9 11 1.3x
ZTS 15 9 27 1.9x
oxc (node) 59 57 63 7.4x
SWC 140 129 156 17.5x

bundle — small (10 modules)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 2 2 2 1.0x
Bun 6 6 6 3.0x
esbuild 7 6 7 3.5x
rspack 122 106 138 61.0x
rolldown 136 131 141 68.0x
webpack 406 386 428 203.0x

bundle — medium (50 modules)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 8 6 11 1.0x
esbuild 11 10 12 1.4x
Bun 15 12 19 1.9x
rolldown 109 103 122 13.6x
rspack 142 125 174 17.8x
webpack 447 359 512 55.9x

bundle — large (200 modules)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 9 9 9 1.0x
Bun 12 10 15 1.3x
esbuild 13 12 14 1.4x
rolldown 111 104 115 12.3x

ubuntu-latest

transpile — small (100 lines)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 1 1 1 1.0x
esbuild 2 2 3 2.0x
Bun 3 3 3 3.0x
oxc (node) 29 29 30 29.0x
SWC 95 91 98 95.0x

transpile — medium (1K lines)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
esbuild 2 2 2 1.0x
ZTS 4 3 4 2.0x
Bun 4 4 5 2.0x
oxc (node) 29 29 30 14.5x
SWC 100 97 105 50.0x

transpile — large (5K lines)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
esbuild 2 2 2 1.0x
Bun 11 11 11 5.5x
ZTS 15 15 15 7.5x
oxc (node) 31 30 31 15.5x
SWC 121 120 123 60.5x

bundle — small (10 modules)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 2 2 2 1.0x
Bun 5 5 5 2.5x
esbuild 7 6 7 3.5x
rspack 118 117 118 59.0x
rolldown 138 115 158 69.0x
webpack 546 540 551 273.0x

bundle — medium (50 modules)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 4 4 5 1.0x
Bun 6 6 6 1.5x
esbuild 8 8 9 2.0x
rolldown 119 117 123 29.8x
rspack 123 123 124 30.8x
webpack 556 535 586 139.0x

bundle — large (200 modules)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
Bun 10 10 10 1.0x
esbuild 16 15 16 1.6x
ZTS 22 22 22 2.2x
rolldown 127 122 131 12.7x

windows-latest

transpile — small (100 lines)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 7 7 8 1.0x
Bun 15 15 15 2.1x
oxc (node) 57 57 58 8.1x

transpile — medium (1K lines)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 9 9 9 1.0x
Bun 15 15 16 1.7x
oxc (node) 56 56 58 6.2x

transpile — large (5K lines)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
Bun 15 15 16 1.0x
ZTS 18 17 18 1.2x
oxc (node) 57 57 58 3.8x

bundle — small (10 modules)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 8 8 8 1.0x
Bun 29 28 31 3.6x

bundle — medium (50 modules)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 14 14 14 1.0x
Bun 31 30 31 2.2x

bundle — large (200 modules)

Tool Avg (ms) Min (ms) Max (ms) vs fastest
ZTS 38 38 39 1.0x
Bun 41 40 41 1.1x

Auto-generated by CI on 2026-03-23 13:34 UTC

@ohah ohah force-pushed the feat/smoke-ci-comment branch 2 times, most recently from 6afaab9 to bc60119 Compare March 23, 2026 13:30
packages/benchmark가 워크스페이스에 포함되지 않아 esbuild가
설치되지 않던 문제 수정.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@ohah ohah force-pushed the feat/smoke-ci-comment branch from bc60119 to 00bb555 Compare March 23, 2026 13:32
@ohah ohah merged commit de6f0ec into main Mar 23, 2026
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant