Skip to content

[draft] more formatting tests #2944

Draft
iisaduan wants to merge 10 commits intomicrosoft:mainfrom
iisaduan:more-formatting
Draft

[draft] more formatting tests #2944
iisaduan wants to merge 10 commits intomicrosoft:mainfrom
iisaduan:more-formatting

Conversation

@iisaduan
Copy link
Copy Markdown
Member

@iisaduan iisaduan commented Mar 1, 2026

using this pr for testing the testing pipelines

@iisaduan
Copy link
Copy Markdown
Member Author

iisaduan commented Mar 5, 2026

@typescript-bot test top 100

@iisaduan
Copy link
Copy Markdown
Member Author

iisaduan commented Mar 5, 2026

@typescript-bot test top100

@typescript-bot
Copy link
Copy Markdown

Hey @iisaduan, this PR is in an unmergable state, so is missing a merge commit to run against; please resolve conflicts and try again.

@iisaduan
Copy link
Copy Markdown
Member Author

iisaduan commented Mar 5, 2026

@typescript-bot test top100

@typescript-bot
Copy link
Copy Markdown

typescript-bot commented Mar 5, 2026

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top100 ❌ Error: Error: Could not queue the build because there were validation errors or warnings.

@iisaduan
Copy link
Copy Markdown
Member Author

iisaduan commented Mar 9, 2026

@typescript-bot test top100

@typescript-bot
Copy link
Copy Markdown

typescript-bot commented Mar 9, 2026

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top100 ❌ Error: Error: Could not queue the build because there were validation errors or warnings.

@typescript-bot
Copy link
Copy Markdown

@@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 81,784 (± 0.01%) 81,783 (± 0.01%) ~ 81,774 81,789 p=0.739 n=6
Types 98,420 98,420 ~ ~ ~ p=1.000 n=6
Memory used 176,655k (± 0.02%) 176,651k (± 0.03%) ~ 176,551k 176,693k p=0.872 n=6
Parse Time 0.201s (± 2.65%) 0.205s (± 1.37%) ~ 0.199s 0.206s p=0.198 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 2.949s (± 3.75%) 2.920s (± 1.07%) ~ 2.894s 2.971s p=0.575 n=6
Total Time 3.151s (± 3.36%) 3.125s (± 1.04%) ~ 3.094s 3.177s p=0.810 n=6
angular-1 - native
Errors 1 1 ~ ~ ~ p=1.000 n=6
Symbols 885,319 (± 0.02%) 885,309 (± 0.01%) ~ 885,111 885,444 p=0.810 n=6
Types 261,875 (± 0.00%) 261,875 ~ ~ ~ p=0.405 n=6
Memory used 850,507k (± 0.07%) 851,872k (± 0.20%) ~ 849,649k 853,777k p=0.173 n=6
Parse Time 1.910s (± 2.28%) 1.910s (± 5.15%) ~ 1.769s 1.986s p=0.575 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 11.200s (± 1.65%) 11.306s (± 3.17%) ~ 10.780s 11.629s p=0.378 n=6
Total Time 13.185s (± 1.72%) 13.289s (± 3.44%) ~ 12.622s 13.691s p=0.378 n=6
mui-docs - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 3,548,214 3,551,308 (± 0.14%) ~ 3,548,214 3,560,156 p=0.176 n=6
Types 1,436,675 1,436,674 (± 0.00%) ~ 1,436,668 1,436,675 p=0.405 n=6
Memory used 4,437,686k (± 0.03%) 4,438,882k (± 0.10%) ~ 4,432,590k 4,445,052k p=0.575 n=6
Parse Time 13.132s (± 8.62%) 12.329s (± 7.27%) ~ 11.071s 13.519s p=0.173 n=6
Bind Time 0.002s (±18.82%) 0.004s (±74.45%) ~ 0.002s 0.009s p=0.214 n=6
Check Time 61.133s (± 2.19%) 61.590s (± 1.72%) ~ 60.180s 63.214s p=0.810 n=6
Emit Time 0.659s (±58.74%) 0.519s (± 5.08%) ~ 0.495s 0.554s p=0.572 n=6
Total Time 76.162s (± 1.88%) 75.710s (± 1.36%) ~ 74.850s 77.036s p=0.575 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,396,625 (± 0.00%) 1,396,615 (± 0.00%) ~ 1,396,607 1,396,634 p=0.206 n=6
Types 441,045 441,045 ~ ~ ~ p=1.000 n=6
Memory used 1,828,171k (± 0.31%) 1,826,941k (± 0.36%) ~ 1,822,617k 1,838,145k p=0.810 n=6
Parse Time 1.342s (± 0.50%) 1.344s (± 0.89%) ~ 1.332s 1.361s p=1.000 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 7.820s (± 0.59%) 7.830s (± 1.12%) ~ 7.759s 8.001s p=1.000 n=6
Emit Time 0.778s (±12.46%) 0.753s (± 6.19%) ~ 0.670s 0.799s p=0.689 n=6
Total Time 110.417s (± 0.27%) 110.266s (± 0.53%) ~ 109.604s 111.240s p=0.298 n=6
self-build-src-public-api - native
Errors 0 0 ~ ~ ~ p=NaN n=0
Symbols 0 0 ~ ~ ~ p=NaN n=0
Types 0 0 ~ ~ ~ p=NaN n=0
Memory used 0k 0k ~ ~ ~ p=NaN n=0
Parse Time 0s 0s ~ ~ ~ p=NaN n=0
Bind Time 0s 0s ~ ~ ~ p=NaN n=0
Check Time 0s 0s ~ ~ ~ p=NaN n=0
Emit Time 0s 0s ~ ~ ~ p=NaN n=0
Total Time 0s 0s ~ ~ ~ p=NaN n=0
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 338,176 338,176 ~ ~ ~ p=1.000 n=6
Types 198,697 198,697 ~ ~ ~ p=1.000 n=6
Memory used 337,558k (± 0.01%) 337,603k (± 0.04%) ~ 337,459k 337,757k p=0.378 n=6
Parse Time 0.508s (± 5.23%) 0.502s (± 5.30%) ~ 0.472s 0.531s p=0.810 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 3.554s (± 4.42%) 3.494s (± 5.51%) ~ 3.267s 3.677s p=0.689 n=6
Emit Time 0.180s (± 3.43%) 0.184s (± 6.98%) ~ 0.172s 0.205s p=0.747 n=6
Total Time 4.411s (± 2.67%) 4.375s (± 3.08%) ~ 4.225s 4.510s p=0.689 n=6
ts-pre-modules - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 752 752 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory used 102,626k (± 0.03%) 102,641k (± 0.02%) ~ 102,620k 102,662k p=0.170 n=6
Parse Time 0.418s (± 5.91%) 0.440s (± 5.43%) ~ 0.395s 0.461s p=0.170 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.418s (± 5.89%) 0.441s (± 5.41%) ~ 0.396s 0.462s p=0.121 n=6
vscode - native
Errors 188 188 ~ ~ ~ p=1.000 n=6
Symbols 5,952,645 (± 0.01%) 5,952,642 (± 0.01%) ~ 5,952,127 5,952,896 p=0.873 n=6
Types 2,248,939 (± 0.00%) 2,248,936 (± 0.00%) ~ 2,248,936 2,248,937 p=0.086 n=6
Memory used 4,178,296k (± 0.03%) 4,177,290k (± 0.04%) ~ 4,175,411k 4,180,676k p=0.230 n=6
Parse Time 4.794s (± 4.79%) 4.886s (± 4.72%) ~ 4.639s 5.233s p=0.810 n=6
Bind Time 1.734s (±23.05%) 1.357s (±34.98%) ~ 0.963s 1.945s p=0.336 n=6
Check Time 32.367s (± 6.93%) 34.274s (± 5.70%) ~ 31.963s 36.696s p=0.173 n=6
Emit Time 10.879s (±17.90%) 9.522s (± 8.61%) ~ 8.854s 10.667s p=0.230 n=6
Total Time 50.027s (± 2.23%) 50.285s (± 2.56%) ~ 49.231s 52.575s p=0.689 n=6
webpack - native
Errors 1,145 1,145 ~ ~ ~ p=1.000 n=6
Symbols 692,064 (± 0.00%) 692,054 (± 0.00%) ~ 692,016 692,076 p=0.519 n=6
Types 327,023 327,023 ~ ~ ~ p=1.000 n=6
Memory used 559,431k (± 0.03%) 559,547k (± 0.02%) ~ 559,418k 559,687k p=0.173 n=6
Parse Time 0.914s (± 3.40%) 0.867s (± 4.22%) 🟩-0.048s (- 5.21%) 0.829s 0.915s p=0.045 n=6
Bind Time 0.182s (±18.19%) 0.278s (±25.81%) 🔻+0.096s (+52.70%) 0.157s 0.354s p=0.030 n=6
Check Time 4.488s (± 5.44%) 4.124s (± 5.88%) 🟩-0.364s (- 8.11%) 3.901s 4.578s p=0.045 n=6
Emit Time 0.006s (±22.76%) 0.007s (±65.65%) ~ 0.005s 0.016s p=0.491 n=6
Total Time 5.667s (± 4.01%) 5.349s (± 3.63%) 🟩-0.319s (- 5.62%) 5.155s 5.702s p=0.045 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 999,001 999,001 ~ ~ ~ p=1.000 n=6
Types 349,431 349,431 ~ ~ ~ p=1.000 n=6
Memory used 617,615k (± 0.01%) 617,549k (± 0.01%) ~ 617,479k 617,676k p=0.173 n=6
Parse Time 0.844s (± 3.32%) 0.833s (± 2.11%) ~ 0.808s 0.855s p=0.518 n=6
Bind Time 0.302s (±22.46%) 0.323s (±17.74%) ~ 0.220s 0.371s p=0.575 n=6
Check Time 4.319s (± 5.32%) 4.258s (± 4.70%) ~ 4.139s 4.632s p=1.000 n=6
Emit Time 0.002s 0.004s (±117.03%) ~ 0.002s 0.013s p=0.405 n=6
Total Time 5.495s (± 3.45%) 5.444s (± 2.85%) ~ 5.347s 5.731s p=0.936 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-build-src-public-api - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

lsp

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsLSP - native
Req 1 - updateOpen 20ms (±21.43%) 19ms (± 2.13%) ~ 19ms 20ms p=0.924 n=6
Req 2 - geterr 937ms (± 0.45%) 949ms (± 2.64%) ~ 936ms 1,000ms p=0.139 n=6
Req 3 - references 78ms (±26.77%) 82ms (±26.27%) ~ 38ms 92ms p=0.261 n=6
Req 4 - navto 17ms (± 3.32%) 17ms (± 2.42%) ~ 16ms 17ms p=0.282 n=6
Req 5 - completionInfo count 1,357 1,357 ~ ~ ~ p=1.000 n=6
Req 5 - completionInfo 13ms (± 4.38%) 13ms (± 4.38%) ~ 12ms 13ms p=1.000 n=6
CompilerLSP - native
Req 1 - updateOpen 19ms (±18.80%) 19ms (±28.82%) ~ 13ms 29ms p=0.744 n=6
Req 2 - geterr 424ms (± 1.89%) 428ms (± 1.23%) ~ 422ms 437ms p=0.629 n=6
Req 3 - references 49ms (±28.01%) 45ms (± 3.69%) ~ 43ms 46ms p=0.652 n=6
Req 4 - navto 18ms (± 2.92%) 18ms (± 2.29%) ~ 17ms 18ms p=0.595 n=6
Req 5 - completionInfo count 1,519 1,519 ~ ~ ~ p=1.000 n=6
Req 5 - completionInfo 15ms (± 5.56%) 15ms ~ ~ ~ p=0.405 n=6
System info unknown
Hosts
  • native
Scenarios
  • CompilerLSP - native
  • Compiler-UnionsLSP - native
  • xstate-main-1-LSP - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - native
Execution time 0.03ms (±514.58%) 0.03ms (±514.45%) 🟩-0.00ms (- 5.58%) 0.00ms 2.94ms p=0.002 n=600
tsserver-startup - native
Execution time 0.04ms (±514.92%) 0.05ms (±514.64%) 🔻+0.01ms (+13.94%) 0.00ms 4.72ms p=0.000 n=600
tsserverlibrary-startup - native
Execution time 0.04ms (±514.94%) 0.04ms (±515.06%) +0.00ms (+ 1.29%) 0.00ms 4.24ms p=0.004 n=600
typescript-startup - native
Execution time 0.04ms (±514.70%) 0.04ms (±515.94%) ~ 0.00ms 4.84ms p=0.743 n=600
System info unknown
Hosts
  • native
Scenarios
  • tsc-startup - native
  • tsserver-startup - native
  • tsserverlibrary-startup - native
  • typescript-startup - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@iisaduan
Copy link
Copy Markdown
Member Author

@typescript-bot test top100

@typescript-bot
Copy link
Copy Markdown

Hey @iisaduan, this PR is in an unmergable state, so is missing a merge commit to run against; please resolve conflicts and try again.

@iisaduan
Copy link
Copy Markdown
Member Author

@typescript-bot test top100

@typescript-bot
Copy link
Copy Markdown

typescript-bot commented Mar 30, 2026

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top100 ❌ Error: Error: Could not queue the build because there were validation errors or warnings.

@typescript-bot
Copy link
Copy Markdown

@iisaduan
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 81,784 (± 0.01%) 81,785 (± 0.01%) ~ 81,781 81,789 p=0.935 n=6
Types 98,420 98,420 ~ ~ ~ p=1.000 n=6
Memory used 176,751k (± 0.07%) 176,722k (± 0.04%) ~ 176,638k 176,825k p=0.810 n=6
Parse Time 0.199s (± 2.88%) 0.206s (± 0.20%) ~ 0.205s 0.206s p=0.060 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 2.945s (± 3.16%) 2.898s (± 0.75%) ~ 2.878s 2.938s p=0.298 n=6
Total Time 3.145s (± 2.86%) 3.105s (± 0.70%) ~ 3.084s 3.144s p=0.423 n=6
angular-1 - native
Errors 1 1 ~ ~ ~ p=1.000 n=6
Symbols 884,992 (± 0.08%) 884,639 (± 0.18%) ~ 881,447 885,380 p=1.000 n=6
Types 261,875 (± 0.00%) 261,876 (± 0.00%) ~ 261,875 261,877 p=0.595 n=6
Memory used 851,235k (± 0.19%) 850,889k (± 0.13%) ~ 849,338k 852,896k p=0.471 n=6
Parse Time 1.912s (± 3.65%) 1.939s (± 2.48%) ~ 1.891s 2.004s p=0.575 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 11.211s (± 2.19%) 11.363s (± 1.64%) ~ 11.144s 11.642s p=0.378 n=6
Total Time 13.196s (± 2.38%) 13.377s (± 1.73%) ~ 13.118s 13.711s p=0.471 n=6
mui-docs - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 3,549,296 (± 0.08%) 3,548,196 (± 0.00%) ~ 3,548,195 3,548,196 p=0.218 n=6
Types 1,436,665 1,436,665 ~ ~ ~ p=1.000 n=6
Memory used 4,441,829k (± 0.08%) 4,438,542k (± 0.06%) ~ 4,434,437k 4,442,542k p=0.128 n=6
Parse Time 12.959s (± 5.44%) 12.977s (± 5.76%) ~ 11.778s 13.637s p=0.936 n=6
Bind Time 0.003s (±64.39%) 0.003s (±45.37%) ~ 0.002s 0.005s p=0.924 n=6
Check Time 61.982s (± 2.03%) 60.886s (± 1.67%) ~ 58.974s 61.944s p=0.173 n=6
Emit Time 0.506s (± 1.37%) 0.633s (±46.90%) ~ 0.500s 1.239s p=1.000 n=6
Total Time 76.758s (± 1.50%) 75.696s (± 1.68%) ~ 73.708s 77.094s p=0.173 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,396,617 (± 0.00%) 1,396,612 (± 0.00%) ~ 1,396,607 1,396,629 p=0.474 n=6
Types 441,045 441,045 ~ ~ ~ p=1.000 n=6
Memory used 1,832,282k (± 0.29%) 1,828,032k (± 0.40%) ~ 1,821,428k 1,839,620k p=0.230 n=6
Parse Time 1.346s (± 0.47%) 1.346s (± 0.70%) ~ 1.334s 1.359s p=0.936 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 7.866s (± 1.79%) 7.845s (± 1.60%) ~ 7.697s 8.000s p=0.810 n=6
Emit Time 0.743s (±17.75%) 0.764s (±13.54%) ~ 0.634s 0.942s p=1.000 n=6
Total Time 110.850s (± 0.89%) 110.701s (± 1.02%) ~ 109.762s 112.854s p=0.575 n=6
self-build-src-public-api - native
Errors 0 0 ~ ~ ~ p=NaN n=0
Symbols 0 0 ~ ~ ~ p=NaN n=0
Types 0 0 ~ ~ ~ p=NaN n=0
Memory used 0k 0k ~ ~ ~ p=NaN n=0
Parse Time 0s 0s ~ ~ ~ p=NaN n=0
Bind Time 0s 0s ~ ~ ~ p=NaN n=0
Check Time 0s 0s ~ ~ ~ p=NaN n=0
Emit Time 0s 0s ~ ~ ~ p=NaN n=0
Total Time 0s 0s ~ ~ ~ p=NaN n=0
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 338,176 338,176 ~ ~ ~ p=1.000 n=6
Types 198,697 198,697 ~ ~ ~ p=1.000 n=6
Memory used 337,587k (± 0.03%) 337,522k (± 0.02%) ~ 337,410k 337,614k p=0.230 n=6
Parse Time 0.494s (± 4.48%) 0.517s (± 4.13%) ~ 0.474s 0.530s p=0.092 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 3.441s (± 4.70%) 3.609s (± 3.66%) ~ 3.343s 3.688s p=0.066 n=6
Emit Time 0.194s (±12.09%) 0.180s (± 3.35%) ~ 0.172s 0.186s p=0.092 n=6
Total Time 4.332s (± 2.43%) 4.453s (± 2.29%) ~ 4.251s 4.527s p=0.066 n=6
ts-pre-modules - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 752 752 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory used 102,647k (± 0.02%) 102,614k (± 0.03%) -33k (- 0.03%) 102,581k 102,659k p=0.037 n=6
Parse Time 0.419s (± 6.44%) 0.429s (± 6.28%) ~ 0.395s 0.459s p=0.415 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.420s (± 6.40%) 0.429s (± 6.34%) ~ 0.395s 0.460s p=0.806 n=6
vscode - native
Errors 188 188 ~ ~ ~ p=1.000 n=6
Symbols 5,952,429 (± 0.01%) 5,952,341 (± 0.01%) ~ 5,951,960 5,952,706 p=0.936 n=6
Types 2,250,417 2,250,417 ~ ~ ~ p=1.000 n=6
Memory used 4,177,599k (± 0.02%) 4,177,511k (± 0.03%) ~ 4,175,378k 4,179,704k p=0.689 n=6
Parse Time 5.055s (± 6.90%) 4.997s (± 6.15%) ~ 4.631s 5.364s p=0.810 n=6
Bind Time 1.351s (±31.05%) 1.473s (±30.15%) ~ 0.992s 2.029s p=0.378 n=6
Check Time 33.198s (± 5.73%) 32.792s (± 4.66%) ~ 30.358s 34.976s p=0.936 n=6
Emit Time 11.379s (±19.92%) 11.586s (±21.16%) ~ 8.876s 14.357s p=0.936 n=6
Total Time 51.233s (± 4.08%) 51.103s (± 4.37%) ~ 48.806s 53.960s p=0.810 n=6
webpack - native
Errors 1,145 1,145 ~ ~ ~ p=1.000 n=6
Symbols 692,038 (± 0.00%) 692,058 (± 0.00%) ~ 692,022 692,090 p=0.225 n=6
Types 327,025 327,025 ~ ~ ~ p=1.000 n=6
Memory used 559,512k (± 0.01%) 559,539k (± 0.03%) ~ 559,224k 559,684k p=0.471 n=6
Parse Time 0.905s (± 3.49%) 0.900s (± 3.31%) ~ 0.861s 0.944s p=0.810 n=6
Bind Time 0.184s (±33.53%) 0.247s (±30.30%) ~ 0.161s 0.338s p=0.064 n=6
Check Time 4.472s (± 6.88%) 4.203s (± 6.58%) ~ 3.938s 4.609s p=0.173 n=6
Emit Time 0.005s (±12.64%) 0.005s (± 9.95%) ~ 0.005s 0.006s p=0.201 n=6
Total Time 5.634s (± 4.79%) 5.430s (± 4.29%) ~ 5.212s 5.813s p=0.230 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 999,001 999,001 ~ ~ ~ p=1.000 n=6
Types 349,431 349,431 ~ ~ ~ p=1.000 n=6
Memory used 617,549k (± 0.01%) 617,548k (± 0.01%) ~ 617,448k 617,661k p=0.936 n=6
Parse Time 0.827s (± 2.01%) 0.836s (± 3.98%) ~ 0.804s 0.893s p=0.936 n=6
Bind Time 0.344s (± 5.44%) 0.300s (±31.09%) ~ 0.162s 0.368s p=1.000 n=6
Check Time 4.180s (± 1.54%) 4.332s (± 7.00%) ~ 4.111s 4.815s p=1.000 n=6
Emit Time 0.002s 0.002s ~ ~ ~ p=1.000 n=6
Total Time 5.380s (± 1.08%) 5.500s (± 4.38%) ~ 5.314s 5.895s p=0.689 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-build-src-public-api - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

lsp

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsLSP - native
Req 1 - updateOpen 18ms (±16.83%) 18ms (±30.18%) ~ 12ms 28ms p=0.505 n=6
Req 2 - geterr 939ms (± 0.54%) 938ms (± 0.25%) ~ 934ms 940ms p=0.872 n=6
Req 3 - references 49ms (±17.02%) 50ms (±21.65%) ~ 32ms 58ms p=0.462 n=6
Req 4 - navto 17ms (± 2.42%) 17ms (± 2.42%) ~ 16ms 17ms p=1.000 n=6
CompilerLSP - native
Req 1 - updateOpen 20ms (±28.75%) 19ms (±18.12%) ~ 12ms 21ms p=0.871 n=6
Req 2 - geterr 420ms (± 1.74%) 424ms (± 1.54%) ~ 411ms 428ms p=0.296 n=6
Req 3 - references 31ms (± 1.65%) 31ms (± 2.44%) ~ 30ms 32ms p=0.241 n=6
Req 4 - navto 19ms (± 4.37%) 19ms (± 2.96%) ~ 18ms 19ms p=0.441 n=6
System info unknown
Hosts
  • native
Scenarios
  • CompilerLSP - native
  • Compiler-UnionsLSP - native
  • xstate-main-1-LSP - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - native
Execution time 0.03ms (±514.58%) 0.03ms (±514.50%) ~ 0.00ms 3.02ms p=0.883 n=600
tsserver-startup - native
Execution time 0.04ms (±515.78%) 0.04ms (±514.71%) 🟩-0.00ms (- 7.68%) 0.00ms 4.01ms p=0.000 n=600
tsserverlibrary-startup - native
Execution time 0.04ms (±514.92%) 0.04ms (±515.22%) -0.00ms (- 1.02%) 0.00ms 4.30ms p=0.000 n=600
typescript-startup - native
Execution time 0.04ms (±515.06%) 0.04ms (±515.15%) 🔻+0.00ms (+ 5.56%) 0.00ms 4.86ms p=0.000 n=600
System info unknown
Hosts
  • native
Scenarios
  • tsc-startup - native
  • tsserver-startup - native
  • tsserverlibrary-startup - native
  • typescript-startup - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@gabritto
Copy link
Copy Markdown
Member

@typescript-bot test tsserver top10

@typescript-bot
Copy link
Copy Markdown

typescript-bot commented Mar 30, 2026

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test tsserver top10 ❌ Error: Error: Could not queue the build because there were validation errors or warnings.

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,778 (± 0.01%) 81,801 (± 0.03%) ~ 81,770 81,821 p=0.195 n=6
Types 98,821 98,821 ~ ~ ~ p=1.000 n=6
Memory used 174,272k (± 0.06%) 174,232k (± 0.06%) ~ 174,138k 174,397k p=0.471 n=6
Parse Time 0.193s (± 0.43%) 0.193s (± 0.21%) ~ 0.192s 0.193s p=0.527 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 3.082s (± 3.78%) 3.056s (± 3.70%) ~ 2.864s 3.153s p=0.471 n=6
Total Time 3.275s (± 3.55%) 3.250s (± 3.47%) ~ 3.058s 3.347s p=0.471 n=6
angular-1 - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 885,334 (± 0.01%) 885,311 (± 0.02%) ~ 885,209 885,564 p=0.575 n=6
Types 263,843 (± 0.00%) 263,842 ~ ~ ~ p=0.071 n=6
Memory used 841,312k (± 0.24%) 840,215k (± 0.12%) ~ 839,297k 841,573k p=0.378 n=6
Parse Time 1.838s (± 6.15%) 1.899s (± 4.99%) ~ 1.726s 1.967s p=0.423 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 10.950s (± 3.55%) 11.178s (± 2.63%) ~ 10.660s 11.428s p=0.378 n=6
Total Time 12.825s (± 3.73%) 13.117s (± 2.97%) ~ 12.423s 13.429s p=0.378 n=6
mui-docs - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 3,791,973 3,791,973 ~ ~ ~ p=1.000 n=6
Types 1,443,165 1,443,165 ~ ~ ~ p=1.000 n=6
Memory used 4,469,829k (± 0.03%) 4,470,061k (± 0.03%) ~ 4,468,840k 4,472,419k p=0.689 n=6
Parse Time 13.479s (± 3.23%) 14.564s (± 4.37%) 🔻+1.085s (+ 8.05%) 13.825s 15.475s p=0.008 n=6
Bind Time 0.002s (±18.82%) 0.002s ~ ~ ~ p=0.405 n=6
Check Time 61.325s (± 1.60%) 61.691s (± 1.47%) ~ 61.155s 63.513s p=0.471 n=6
Emit Time 0.661s (±57.46%) 0.496s (± 0.81%) ~ 0.493s 0.503s p=0.872 n=6
Total Time 76.523s (± 0.97%) 77.797s (± 1.53%) +1.274s (+ 1.66%) 76.596s 79.636s p=0.045 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,396,603 (± 0.00%) 1,396,603 (± 0.00%) ~ 1,396,598 1,396,620 p=1.000 n=6
Types 442,163 442,163 ~ ~ ~ p=1.000 n=6
Memory used 1,789,555k (± 0.57%) 1,784,819k (± 0.27%) ~ 1,776,252k 1,791,557k p=0.230 n=6
Parse Time 1.356s (± 1.51%) 1.341s (± 1.58%) ~ 1.300s 1.361s p=0.575 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 7.932s (± 3.03%) 7.818s (± 2.21%) ~ 7.579s 8.026s p=0.471 n=6
Emit Time 0.688s (±22.81%) 0.756s (± 4.06%) ~ 0.701s 0.780s p=0.230 n=6
Total Time 110.700s (± 1.91%) 110.224s (± 1.01%) ~ 109.049s 111.906s p=1.000 n=6
self-build-src-public-api - native
Errors 0 0 ~ ~ ~ p=NaN n=0
Symbols 0 0 ~ ~ ~ p=NaN n=0
Types 0 0 ~ ~ ~ p=NaN n=0
Memory used 0k 0k ~ ~ ~ p=NaN n=0
Parse Time 0s 0s ~ ~ ~ p=NaN n=0
Bind Time 0s 0s ~ ~ ~ p=NaN n=0
Check Time 0s 0s ~ ~ ~ p=NaN n=0
Emit Time 0s 0s ~ ~ ~ p=NaN n=0
Total Time 0s 0s ~ ~ ~ p=NaN n=0
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 338,176 338,176 ~ ~ ~ p=1.000 n=6
Types 199,525 199,525 ~ ~ ~ p=1.000 n=6
Memory used 329,432k (± 0.03%) 329,431k (± 0.03%) ~ 329,269k 329,504k p=1.000 n=6
Parse Time 0.513s (± 2.67%) 0.520s (± 3.02%) ~ 0.493s 0.536s p=0.468 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 3.593s (± 2.14%) 3.512s (± 4.16%) ~ 3.250s 3.641s p=0.336 n=6
Emit Time 0.201s (± 1.68%) 0.260s (±27.62%) ~ 0.190s 0.346s p=0.572 n=6
Total Time 4.442s (± 1.44%) 4.457s (± 2.04%) ~ 4.289s 4.545s p=0.810 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 752 752 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory used 102,628k (± 0.03%) 102,602k (± 0.02%) ~ 102,570k 102,611k p=0.109 n=6
Parse Time 0.451s (± 3.06%) 0.444s (± 2.07%) ~ 0.437s 0.461s p=0.295 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.452s (± 3.05%) 0.445s (± 2.01%) ~ 0.437s 0.461s p=0.288 n=6
vscode - native
Errors 188 188 ~ ~ ~ p=1.000 n=6
Symbols 5,959,005 (± 0.00%) 5,958,973 (± 0.00%) ~ 5,958,806 5,959,085 p=0.688 n=6
Types 2,253,465 2,253,465 ~ ~ ~ p=1.000 n=6
Memory used 4,065,552k (± 0.54%) 4,063,656k (± 0.55%) ~ 4,048,881k 4,108,929k p=0.936 n=6
Parse Time 5.063s (± 5.42%) 5.021s (± 4.76%) ~ 4.672s 5.373s p=0.936 n=6
Bind Time 1.116s (±35.19%) 1.108s (±31.08%) ~ 0.950s 1.810s p=0.936 n=6
Check Time 35.027s (± 4.87%) 35.081s (± 4.50%) ~ 32.348s 36.860s p=0.936 n=6
Emit Time 9.647s (±12.64%) 9.157s (±11.33%) ~ 8.501s 11.034s p=0.810 n=6
Total Time 50.965s (± 3.03%) 50.480s (± 3.10%) ~ 48.690s 52.779s p=0.810 n=6
webpack - native
Errors 1,145 1,145 ~ ~ ~ p=1.000 n=6
Symbols 692,052 (± 0.00%) 692,081 (± 0.00%) ~ 692,069 692,102 p=0.101 n=6
Types 327,171 327,171 ~ ~ ~ p=1.000 n=6
Memory used 545,931k (± 0.02%) 545,973k (± 0.02%) ~ 545,824k 546,078k p=0.378 n=6
Parse Time 0.871s (± 2.93%) 0.877s (± 2.75%) ~ 0.840s 0.908s p=0.689 n=6
Bind Time 0.193s (±31.93%) 0.212s (±38.30%) ~ 0.154s 0.351s p=0.514 n=6
Check Time 4.399s (± 4.08%) 4.331s (± 5.57%) ~ 3.957s 4.597s p=0.575 n=6
Emit Time 0.005s (±17.48%) 0.005s (±14.55%) ~ 0.004s 0.006s p=0.340 n=6
Total Time 5.500s (± 2.66%) 5.460s (± 3.25%) ~ 5.189s 5.694s p=0.689 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 998,947 998,947 ~ ~ ~ p=1.000 n=6
Types 349,427 349,427 ~ ~ ~ p=1.000 n=6
Memory used 600,720k (± 0.01%) 600,730k (± 0.01%) ~ 600,659k 600,790k p=0.873 n=6
Parse Time 0.902s (± 2.26%) 0.901s (± 2.56%) ~ 0.875s 0.932s p=1.000 n=6
Bind Time 0.214s (±16.33%) 0.231s (±18.73%) ~ 0.171s 0.286s p=0.521 n=6
Check Time 4.637s (± 3.25%) 4.612s (± 4.80%) ~ 4.330s 4.943s p=1.000 n=6
Emit Time 0.002s 0.002s ~ ~ ~ p=1.000 n=6
Total Time 5.772s (± 2.38%) 5.761s (± 3.48%) ~ 5.507s 6.063s p=1.000 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-build-src-public-api - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

lsp

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsLSP - native
Req 1 - updateOpen 19ms (±24.33%) 14ms (±25.53%) ~ 11ms 19ms p=0.134 n=6
Req 2 - geterr 948ms (± 3.75%) 938ms (± 2.96%) ~ 924ms 994ms p=0.872 n=6
Req 3 - references 39ms (±21.19%) 41ms (±15.10%) ~ 28ms 43ms p=0.787 n=6
Req 4 - navto 17ms 16ms (± 3.16%) 🟩-1ms (- 3.92%) 16ms 17ms p=0.025 n=6
CompilerLSP - native
Req 1 - updateOpen 17ms (±21.02%) 22ms (±21.30%) ~ 18ms 28ms p=0.195 n=6
Req 2 - geterr 425ms (± 1.88%) 424ms (± 2.02%) ~ 409ms 435ms p=0.936 n=6
Req 3 - references 31ms (± 2.66%) 31ms (± 3.19%) ~ 29ms 32ms p=0.604 n=6
Req 4 - navto 18ms 18ms ~ ~ ~ p=1.000 n=6
System info unknown
Hosts
  • native
Scenarios
  • CompilerLSP - native
  • Compiler-UnionsLSP - native
  • xstate-main-1-LSP - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - native
Execution time 0.03ms (±514.48%) 0.03ms (±514.98%) 🔻+0.00ms (+ 5.01%) 0.00ms 3.29ms p=0.000 n=600
tsserver-startup - native
Execution time 0.04ms (±515.02%) 0.04ms (±517.34%) -0.00ms (- 0.68%) 0.00ms 4.68ms p=0.000 n=600
tsserverlibrary-startup - native
Execution time 0.04ms (±515.02%) 0.04ms (±515.69%) 🟩-0.00ms (- 5.07%) 0.00ms 4.04ms p=0.000 n=600
typescript-startup - native
Execution time 0.04ms (±515.05%) 0.04ms (±514.97%) +0.00ms (+ 2.46%) 0.00ms 4.22ms p=0.000 n=600
System info unknown
Hosts
  • native
Scenarios
  • tsc-startup - native
  • tsserver-startup - native
  • tsserverlibrary-startup - native
  • typescript-startup - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,784 (± 0.02%) 81,776 (± 0.01%) ~ 81,770 81,785 p=0.566 n=6
Types 98,821 98,821 ~ ~ ~ p=1.000 n=6
Memory used 174,262k (± 0.05%) 174,247k (± 0.06%) ~ 174,155k 174,459k p=0.470 n=6
Parse Time 0.193s 0.198s (± 2.82%) ~ 0.193s 0.206s p=0.074 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 3.092s (± 1.64%) 3.034s (± 4.07%) ~ 2.888s 3.175s p=0.575 n=6
Total Time 3.285s (± 1.54%) 3.233s (± 3.68%) ~ 3.087s 3.368s p=0.575 n=6
angular-1 - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 885,295 (± 0.01%) 885,294 (± 0.02%) ~ 885,143 885,485 p=0.936 n=6
Types 263,843 (± 0.00%) 263,843 (± 0.00%) ~ 263,842 263,844 p=1.000 n=6
Memory used 841,032k (± 0.20%) 841,366k (± 0.19%) ~ 839,575k 843,472k p=0.575 n=6
Parse Time 1.916s (± 4.77%) 1.853s (± 5.96%) ~ 1.737s 1.980s p=0.173 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 11.289s (± 2.72%) 11.055s (± 3.05%) ~ 10.642s 11.481s p=0.173 n=6
Total Time 13.241s (± 3.01%) 12.944s (± 3.44%) ~ 12.418s 13.497s p=0.173 n=6
mui-docs - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 3,791,973 (± 0.00%) 3,793,085 (± 0.07%) ~ 3,791,973 3,798,643 p=0.218 n=6
Types 1,443,165 1,443,165 ~ ~ ~ p=1.000 n=6
Memory used 4,469,970k (± 0.05%) 4,472,139k (± 0.19%) ~ 4,462,227k 4,487,851k p=0.810 n=6
Parse Time 13.000s (± 9.18%) 13.385s (± 7.61%) ~ 11.715s 14.662s p=0.378 n=6
Bind Time 0.002s (±22.11%) 0.003s (±21.89%) ~ 0.002s 0.003s p=0.640 n=6
Check Time 62.465s (± 2.87%) 61.929s (± 1.20%) ~ 61.186s 62.996s p=0.689 n=6
Emit Time 0.755s (±58.32%) 0.498s (± 0.64%) ~ 0.495s 0.503s p=0.148 n=6
Total Time 77.290s (± 3.68%) 76.953s (± 0.47%) ~ 76.329s 77.376s p=0.471 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,396,609 (± 0.00%) 1,396,617 (± 0.00%) ~ 1,396,598 1,396,625 p=0.201 n=6
Types 442,163 442,163 ~ ~ ~ p=1.000 n=6
Memory used 1,783,276k (± 0.41%) 1,784,769k (± 0.31%) ~ 1,775,037k 1,791,845k p=0.575 n=6
Parse Time 1.351s (± 0.79%) 1.352s (± 0.78%) ~ 1.342s 1.367s p=1.000 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 7.824s (± 2.11%) 7.815s (± 0.79%) ~ 7.708s 7.873s p=0.378 n=6
Emit Time 0.772s (±11.45%) 0.772s (± 6.23%) ~ 0.724s 0.841s p=0.575 n=6
Total Time 109.914s (± 0.95%) 109.571s (± 0.29%) ~ 109.216s 109.959s p=0.936 n=6
self-build-src-public-api - native
Errors 0 0 ~ ~ ~ p=NaN n=0
Symbols 0 0 ~ ~ ~ p=NaN n=0
Types 0 0 ~ ~ ~ p=NaN n=0
Memory used 0k 0k ~ ~ ~ p=NaN n=0
Parse Time 0s 0s ~ ~ ~ p=NaN n=0
Bind Time 0s 0s ~ ~ ~ p=NaN n=0
Check Time 0s 0s ~ ~ ~ p=NaN n=0
Emit Time 0s 0s ~ ~ ~ p=NaN n=0
Total Time 0s 0s ~ ~ ~ p=NaN n=0
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 338,176 338,176 ~ ~ ~ p=1.000 n=6
Types 199,525 199,525 ~ ~ ~ p=1.000 n=6
Memory used 329,421k (± 0.04%) 329,489k (± 0.01%) ~ 329,440k 329,572k p=0.230 n=6
Parse Time 0.411s (± 1.22%) 0.410s (± 1.10%) ~ 0.405s 0.416s p=0.686 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 3.000s (± 0.49%) 2.981s (± 0.31%) -0.019s (- 0.63%) 2.973s 2.998s p=0.030 n=6
Emit Time 0.160s (± 0.97%) 0.161s (± 0.47%) ~ 0.160s 0.162s p=0.120 n=6
Total Time 3.676s (± 0.35%) 3.658s (± 0.26%) -0.018s (- 0.49%) 3.649s 3.676s p=0.020 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 752 752 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory used 102,622k (± 0.02%) 102,610k (± 0.03%) ~ 102,569k 102,651k p=0.803 n=6
Parse Time 0.449s (± 3.82%) 0.443s (± 0.93%) ~ 0.438s 0.447s p=0.688 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.450s (± 3.82%) 0.444s (± 0.93%) ~ 0.439s 0.448s p=0.688 n=6
vscode - native
Errors 188 188 ~ ~ ~ p=1.000 n=6
Symbols 5,977,416 (± 0.00%) 5,977,393 (± 0.00%) ~ 5,977,293 5,977,457 p=0.688 n=6
Types 2,258,297 (± 0.00%) 2,258,297 ~ ~ ~ p=0.405 n=6
Memory used 4,070,046k (± 0.60%) 4,071,923k (± 0.63%) ~ 4,059,256k 4,123,675k p=0.575 n=6
Parse Time 6.159s (± 3.96%) 6.007s (± 3.39%) ~ 5.738s 6.238s p=0.575 n=6
Bind Time 1.367s (±36.31%) 1.367s (±24.07%) ~ 1.154s 1.855s p=0.470 n=6
Check Time 40.671s (± 5.81%) 41.387s (± 4.31%) ~ 39.079s 43.343s p=0.689 n=6
Emit Time 11.900s (±15.61%) 10.281s (± 0.46%) ~ 10.229s 10.357s p=0.093 n=6
Total Time 60.237s (± 2.89%) 59.181s (± 2.80%) ~ 57.137s 61.104s p=0.575 n=6
webpack - native
Errors 1,145 1,145 ~ ~ ~ p=1.000 n=6
Symbols 692,039 (± 0.00%) 692,079 (± 0.01%) ~ 692,023 692,217 p=0.414 n=6
Types 327,171 327,171 ~ ~ ~ p=1.000 n=6
Memory used 545,785k (± 0.03%) 545,991k (± 0.02%) ~ 545,847k 546,097k p=0.093 n=6
Parse Time 0.889s (± 3.06%) 0.918s (± 4.65%) ~ 0.866s 0.969s p=0.230 n=6
Bind Time 0.234s (±34.04%) 0.186s (±39.83%) ~ 0.156s 0.338s p=0.393 n=6
Check Time 4.295s (± 6.42%) 4.525s (± 6.55%) ~ 3.941s 4.737s p=0.230 n=6
Emit Time 0.007s (±73.98%) 0.008s (±83.11%) ~ 0.005s 0.022s p=0.340 n=6
Total Time 5.459s (± 3.83%) 5.674s (± 4.62%) ~ 5.186s 5.916s p=0.173 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 998,947 998,947 ~ ~ ~ p=1.000 n=6
Types 349,427 349,427 ~ ~ ~ p=1.000 n=6
Memory used 600,734k (± 0.02%) 600,709k (± 0.01%) ~ 600,619k 600,792k p=0.378 n=6
Parse Time 0.902s (± 1.87%) 0.906s (± 3.40%) ~ 0.859s 0.941s p=0.936 n=6
Bind Time 0.222s (±19.86%) 0.214s (±30.15%) ~ 0.156s 0.317s p=0.873 n=6
Check Time 4.645s (± 4.18%) 4.714s (± 6.38%) ~ 4.256s 5.013s p=0.810 n=6
Emit Time 0.002s (±22.25%) 0.002s (±22.25%) ~ 0.001s 0.002s p=1.000 n=6
Total Time 5.785s (± 2.80%) 5.849s (± 4.53%) ~ 5.448s 6.125s p=0.689 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-build-src-public-api - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

lsp

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsLSP - native
Req 1 - updateOpen 19ms (±27.43%) 18ms (±12.89%) ~ 13ms 19ms p=0.864 n=6
Req 2 - geterr 928ms (± 0.16%) 926ms (± 0.31%) ~ 923ms 931ms p=0.145 n=6
Req 3 - references 50ms (±14.98%) 46ms (±11.97%) ~ 43ms 57ms p=0.681 n=6
Req 4 - navto 17ms (± 2.42%) 17ms (± 3.10%) ~ 16ms 17ms p=0.595 n=6
CompilerLSP - native
Req 1 - updateOpen 18ms (±16.40%) 19ms (± 4.22%) ~ 19ms 21ms p=0.341 n=6
Req 2 - geterr 425ms (± 0.51%) 426ms (± 0.97%) ~ 420ms 430ms p=0.687 n=6
Req 3 - references 31ms (± 2.74%) 31ms (± 3.19%) ~ 29ms 32ms p=0.445 n=6
Req 4 - navto 18ms (± 2.29%) 18ms ~ ~ ~ p=0.405 n=6
System info unknown
Hosts
  • native
Scenarios
  • CompilerLSP - native
  • Compiler-UnionsLSP - native
  • xstate-main-1-LSP - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - native
Execution time 0.03ms (±514.59%) 0.04ms (±524.94%) 🔻+0.01ms (+18.11%) 0.00ms 5.11ms p=0.000 n=600
tsserver-startup - native
Execution time 0.04ms (±514.83%) 0.04ms (±515.10%) 🔻+0.00ms (+ 5.32%) 0.00ms 4.25ms p=0.000 n=600
tsserverlibrary-startup - native
Execution time 0.04ms (±515.20%) 0.04ms (±514.89%) +0.00ms (+ 3.34%) 0.00ms 4.21ms p=0.000 n=600
typescript-startup - native
Execution time 0.04ms (±515.48%) 0.04ms (±515.40%) 🟩-0.00ms (- 5.32%) 0.00ms 4.21ms p=0.000 n=600
System info unknown
Hosts
  • native
Scenarios
  • tsc-startup - native
  • tsserver-startup - native
  • tsserverlibrary-startup - native
  • typescript-startup - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@iisaduan
Copy link
Copy Markdown
Member Author

iisaduan commented Apr 1, 2026

@typescript-bot test top100

@typescript-bot
Copy link
Copy Markdown

typescript-bot commented Apr 1, 2026

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
test top100 ✅ Started ✅ Results

@typescript-bot
Copy link
Copy Markdown

@iisaduan Here are the results of running the top 400 repos with tsc comparing main and refs/pull/2944/merge:

Everything looks good!

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,797 (± 0.04%) 81,824 (± 0.01%) +26 (+ 0.03%) 81,807 81,836 p=0.045 n=6
Types 98,821 98,821 ~ ~ ~ p=1.000 n=6
Memory Used 175,043k (± 0.05%) 174,928k (± 0.05%) -115k (- 0.07%) 174,824k 175,071k p=0.045 n=6
Memory Allocs 1,771,630 (± 0.01%) 1,771,563 (± 0.01%) ~ 1,771,316 1,771,751 p=0.471 n=6
Config Time 0.000s 0.000s (±244.70%) ~ 0.000s 0.001s p=0.405 n=6
Parse Time 0.062s (± 4.62%) 0.064s (± 4.93%) ~ 0.060s 0.068s p=0.258 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 1.022s (± 2.28%) 1.010s (± 1.83%) ~ 0.986s 1.033s p=0.377 n=6
Total Time 1.084s (± 2.02%) 1.074s (± 1.91%) ~ 1.049s 1.102s p=0.423 n=6
angular-1 - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 884,842 (± 0.09%) 884,867 (± 0.07%) ~ 883,907 885,400 p=1.000 n=6
Types 263,843 (± 0.00%) 263,842 (± 0.00%) ~ 263,840 263,844 p=0.553 n=6
Memory Used 835,621k (± 0.06%) 835,325k (± 0.10%) ~ 834,044k 836,291k p=0.575 n=6
Memory Allocs 6,719,538 (± 0.29%) 6,713,390 (± 0.05%) ~ 6,709,636 6,718,944 p=0.471 n=6
Config Time 0.038s (± 8.71%) 0.038s (±10.51%) ~ 0.034s 0.046s p=0.936 n=6
Parse Time 0.251s (± 3.06%) 0.255s (± 8.06%) ~ 0.224s 0.274s p=0.689 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 2.060s (± 1.58%) 2.051s (± 0.55%) ~ 2.038s 2.070s p=1.000 n=6
Total Time 2.350s (± 1.31%) 2.346s (± 1.02%) ~ 2.308s 2.368s p=0.810 n=6
mui-docs - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 3,805,864 3,805,864 ~ ~ ~ p=1.000 n=6
Types 1,464,079 1,464,079 ~ ~ ~ p=1.000 n=6
Memory Used 4,460,630k (± 0.03%) 4,462,226k (± 0.07%) ~ 4,459,090k 4,466,065k p=0.298 n=6
Memory Allocs 106,852,254 (±15.14%) 91,693,038 (±22.75%) ~ 72,493,502 121,834,204 p=0.230 n=6
Config Time 0.031s (±10.33%) 0.033s (± 6.61%) ~ 0.030s 0.036s p=0.146 n=6
Parse Time 1.347s (±18.99%) 1.138s (±31.33%) ~ 0.790s 1.600s p=0.298 n=6
Bind Time 0.002s (±18.82%) 0.002s ~ ~ ~ p=0.405 n=6
Check Time 15.069s (± 0.60%) 15.083s (± 0.58%) ~ 15.011s 15.202s p=0.810 n=6
Emit Time 0.542s (± 5.97%) 0.540s (± 5.72%) ~ 0.497s 0.565s p=0.684 n=6
Total Time 17.438s (± 1.41%) 17.336s (± 1.94%) ~ 16.956s 17.714s p=0.748 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,396,619 1,396,619 ~ ~ ~ p=1.000 n=6
Types 442,163 442,163 ~ ~ ~ p=1.000 n=6
Memory Used 1,639,411k (± 0.10%) 1,641,482k (± 0.49%) ~ 1,631,584k 1,651,709k p=0.378 n=6
Memory Allocs 57,316,527 (± 0.10%) 57,326,733 (± 0.11%) ~ 57,218,703 57,376,138 p=0.575 n=6
Config Time 0.024s (±22.71%) 0.024s (±21.77%) ~ 0.015s 0.029s p=0.689 n=6
Parse Time 0.273s (± 2.26%) 0.272s (± 2.90%) ~ 0.262s 0.281s p=0.810 n=6
Bind Time 0.000s 0.000s (±244.70%) ~ 0.000s 0.001s p=0.405 n=6
Check Time 2.702s (± 0.85%) 2.701s (± 0.78%) ~ 2.673s 2.732s p=0.936 n=6
Emit Time 0.267s (± 4.97%) 0.264s (± 2.74%) ~ 0.256s 0.273s p=0.688 n=6
Total Time 33.859s (± 0.93%) 33.876s (± 0.40%) ~ 33.703s 34.059s p=0.810 n=6
self-build-src-public-api - native
Errors 0 0 ~ ~ ~ p=NaN n=0
Symbols 0 0 ~ ~ ~ p=NaN n=0
Types 0 0 ~ ~ ~ p=NaN n=0
Memory Used 0k 0k ~ ~ ~ p=NaN n=0
Memory Allocs 0 0 ~ ~ ~ p=NaN n=0
Config Time 0s 0s ~ ~ ~ p=NaN n=0
Parse Time 0s 0s ~ ~ ~ p=NaN n=0
Bind Time 0s 0s ~ ~ ~ p=NaN n=0
Check Time 0s 0s ~ ~ ~ p=NaN n=0
Emit Time 0s 0s ~ ~ ~ p=NaN n=0
Total Time 0s 0s ~ ~ ~ p=NaN n=0
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 338,176 338,176 ~ ~ ~ p=1.000 n=6
Types 199,525 199,525 ~ ~ ~ p=1.000 n=6
Memory Used 330,540k (± 0.02%) 330,495k (± 0.04%) ~ 330,270k 330,667k p=0.689 n=6
Memory Allocs 2,552,016 (± 0.02%) 2,551,547 (± 0.02%) ~ 2,550,800 2,552,438 p=0.298 n=6
Config Time 0.001s 0.001s (±34.96%) ~ 0.001s 0.002s p=0.405 n=6
Parse Time 0.136s (± 4.95%) 0.134s (± 5.85%) ~ 0.124s 0.146s p=0.629 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 1.393s (± 0.82%) 1.377s (± 0.52%) -0.016s (- 1.17%) 1.366s 1.383s p=0.031 n=6
Emit Time 0.087s (±13.00%) 0.080s (± 5.32%) ~ 0.076s 0.087s p=0.226 n=6
Total Time 1.671s (± 1.15%) 1.644s (± 0.42%) -0.027s (- 1.65%) 1.635s 1.652s p=0.020 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 752 752 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory Used 103,128k (± 0.04%) 103,114k (± 0.03%) ~ 103,062k 103,149k p=0.378 n=6
Memory Allocs 110,737 (± 0.38%) 110,839 (± 0.23%) ~ 110,357 111,056 p=0.471 n=6
Config Time 0.000s (±244.70%) 0.001s (±109.43%) ~ 0.000s 0.001s p=0.282 n=6
Parse Time 0.112s (± 5.67%) 0.116s (± 2.52%) ~ 0.113s 0.121s p=0.228 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.113s (± 5.75%) 0.117s (± 2.23%) ~ 0.114s 0.121s p=0.261 n=6
vscode - native
Errors 193 193 ~ ~ ~ p=1.000 n=6
Symbols 6,005,060 6,005,060 ~ ~ ~ p=1.000 n=6
Types 2,278,522 2,278,522 ~ ~ ~ p=1.000 n=6
Memory Used 4,094,185k (± 0.03%) 4,094,891k (± 0.05%) ~ 4,092,680k 4,098,150k p=0.689 n=6
Memory Allocs 29,802,142 (± 0.05%) 29,823,557 (± 0.09%) ~ 29,789,529 29,862,397 p=0.093 n=6
Config Time 0.125s (± 4.12%) 0.118s (± 6.79%) ~ 0.102s 0.124s p=0.092 n=6
Parse Time 0.713s (± 2.21%) 0.707s (± 4.02%) ~ 0.659s 0.740s p=1.000 n=6
Bind Time 0.111s (± 3.48%) 0.114s (±12.65%) ~ 0.105s 0.143s p=0.574 n=6
Check Time 8.065s (± 0.95%) 8.049s (± 0.35%) ~ 8.021s 8.101s p=1.000 n=6
Emit Time 1.969s (± 7.68%) 1.972s (± 7.44%) ~ 1.680s 2.086s p=0.936 n=6
Total Time 11.004s (± 0.87%) 10.984s (± 1.11%) ~ 10.744s 11.070s p=0.575 n=6
webpack - native
Errors 1,142 1,142 ~ ~ ~ p=1.000 n=6
Symbols 692,064 692,064 ~ ~ ~ p=1.000 n=6
Types 327,184 327,184 ~ ~ ~ p=1.000 n=6
Memory Used 546,748k (± 0.03%) 546,734k (± 0.03%) ~ 546,474k 546,950k p=0.936 n=6
Memory Allocs 4,184,901 (± 0.28%) 4,187,131 (± 0.33%) ~ 4,178,448 4,214,120 p=0.810 n=6
Config Time 0.013s (±14.73%) 0.013s (±18.69%) ~ 0.009s 0.015s p=0.808 n=6
Parse Time 0.140s (± 3.59%) 0.145s (± 3.57%) ~ 0.140s 0.154s p=0.090 n=6
Bind Time 0.035s (±12.84%) 0.027s (±25.84%) ~ 0.023s 0.041s p=0.076 n=6
Check Time 1.029s (± 1.55%) 1.032s (± 1.29%) ~ 1.014s 1.049s p=0.575 n=6
Emit Time 0.001s (±34.96%) 0.001s ~ ~ ~ p=0.405 n=6
Total Time 1.238s (± 1.08%) 1.238s (± 1.23%) ~ 1.218s 1.252s p=0.936 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 991,165 991,165 ~ ~ ~ p=1.000 n=6
Types 350,724 350,724 ~ ~ ~ p=1.000 n=6
Memory Used 599,622k (± 0.01%) 599,622k (± 0.01%) ~ 599,531k 599,748k p=0.936 n=6
Memory Allocs 4,937,214 (± 0.10%) 4,937,813 (± 0.15%) ~ 4,929,908 4,949,902 p=1.000 n=6
Config Time 0.004s 0.004s (± 9.79%) ~ 0.004s 0.005s p=0.405 n=6
Parse Time 0.117s (± 9.51%) 0.119s (± 9.45%) ~ 0.107s 0.139s p=0.575 n=6
Bind Time 0.031s (±39.38%) 0.027s (±26.27%) ~ 0.022s 0.038s p=0.421 n=6
Check Time 0.965s (± 1.44%) 0.966s (± 1.26%) ~ 0.944s 0.981s p=0.810 n=6
Emit Time 0.001s (±48.94%) 0.001s (±48.94%) ~ 0.000s 0.001s p=1.000 n=6
Total Time 1.120s (± 1.43%) 1.119s (± 1.54%) ~ 1.102s 1.151s p=0.809 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-build-src-public-api - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

lsp

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsLSP - native
Req 1 - updateOpen 9ms 9ms (± 5.53%) ~ 9ms 10ms p=0.174 n=6
Req 2 - geterr 959ms (± 1.25%) 961ms (± 0.55%) ~ 953ms 968ms p=0.630 n=6
Req 3 - references 28ms (± 7.28%) 30ms (±22.10%) ~ 26ms 43ms p=0.788 n=6
Req 4 - navto 16ms (± 2.58%) 16ms (± 4.65%) ~ 15ms 17ms p=0.389 n=6
CompilerLSP - native
Req 1 - updateOpen 10ms (± 4.01%) 10ms ~ ~ ~ p=0.405 n=6
Req 2 - geterr 437ms (± 1.26%) 443ms (± 1.69%) ~ 433ms 452ms p=0.228 n=6
Req 3 - references 33ms (±11.79%) 33ms (± 7.41%) ~ 31ms 37ms p=1.000 n=6
Req 4 - navto 18ms (± 6.55%) 18ms (± 3.51%) ~ 17ms 19ms p=0.485 n=6
System info unknown
Hosts
  • native
Scenarios
  • CompilerLSP - native
  • Compiler-UnionsLSP - native
  • xstate-main-1-LSP - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsgo-startup - native
Execution time 4.61ms (±516.54%) 4.62ms (±516.54%) +0.01ms (+ 0.20%) 0.00ms 464.05ms p=0.004 n=600
tsserver-startup - native
Execution time 5.72ms (±516.54%) 5.73ms (±516.54%) +0.01ms (+ 0.09%) 0.00ms 577.80ms p=0.000 n=600
tsserverlibrary-startup - native
Execution time 5.69ms (±516.54%) 5.73ms (±516.55%) ~ 0.00ms 580.01ms p=0.497 n=600
typescript-startup - native
Execution time 5.69ms (±516.54%) 5.69ms (±516.55%) +0.00ms (+ 0.04%) 0.00ms 576.22ms p=0.000 n=600
System info unknown
Hosts
  • native
Scenarios
  • tsgo-startup - native
  • tsserver-startup - native
  • tsserverlibrary-startup - native
  • typescript-startup - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,814 (± 0.01%) 81,802 (± 0.04%) ~ 81,756 81,832 p=0.809 n=6
Types 98,821 98,821 ~ ~ ~ p=1.000 n=6
Memory Used 174,949k (± 0.07%) 175,033k (± 0.06%) ~ 174,882k 175,178k p=0.336 n=6
Memory Allocs 1,771,601 (± 0.01%) 1,771,629 (± 0.01%) ~ 1,771,512 1,771,859 p=0.936 n=6
Config Time 0.000s 0.000s (±244.70%) ~ 0.000s 0.001s p=0.405 n=6
Parse Time 0.065s (± 6.20%) 0.064s (± 8.02%) ~ 0.061s 0.071s p=0.567 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 1.018s (± 2.27%) 1.007s (± 1.44%) ~ 0.989s 1.024s p=0.261 n=6
Total Time 1.084s (± 1.94%) 1.072s (± 1.71%) ~ 1.050s 1.096s p=0.336 n=6
angular-1 - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 885,147 (± 0.08%) 884,930 (± 0.07%) ~ 883,975 885,527 p=0.298 n=6
Types 263,843 (± 0.00%) 263,843 (± 0.00%) ~ 263,842 263,845 p=0.564 n=6
Memory Used 835,293k (± 0.09%) 835,613k (± 0.08%) ~ 835,003k 836,715k p=0.471 n=6
Memory Allocs 6,725,913 (± 0.26%) 6,714,547 (± 0.10%) ~ 6,705,348 6,725,688 p=0.230 n=6
Config Time 0.041s (±15.12%) 0.038s (±10.35%) ~ 0.033s 0.044s p=0.573 n=6
Parse Time 0.245s (± 4.59%) 0.247s (± 3.94%) ~ 0.237s 0.261s p=0.809 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 2.052s (± 0.86%) 2.052s (± 0.20%) ~ 2.047s 2.057s p=0.810 n=6
Total Time 2.340s (± 1.03%) 2.339s (± 0.52%) ~ 2.324s 2.353s p=0.873 n=6
mui-docs - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 3,805,864 3,805,864 ~ ~ ~ p=1.000 n=6
Types 1,464,079 1,464,079 ~ ~ ~ p=1.000 n=6
Memory Used 4,461,532k (± 0.04%) 4,460,163k (± 0.03%) ~ 4,459,055k 4,462,628k p=0.173 n=6
Memory Allocs 92,881,668 (± 9.97%) 99,469,273 (±19.31%) ~ 71,414,126 116,554,066 p=0.471 n=6
Config Time 0.034s (± 7.33%) 0.033s (±12.26%) ~ 0.027s 0.039s p=0.809 n=6
Parse Time 1.127s (±11.12%) 1.230s (±24.80%) ~ 0.809s 1.623s p=0.471 n=6
Bind Time 0.002s (±18.82%) 0.002s (±18.82%) ~ 0.002s 0.003s p=1.000 n=6
Check Time 15.245s (± 0.69%) 15.273s (± 0.87%) ~ 15.115s 15.464s p=0.810 n=6
Emit Time 0.535s (± 6.47%) 0.533s (± 6.51%) ~ 0.500s 0.568s p=0.630 n=6
Total Time 17.418s (± 0.85%) 17.608s (± 1.69%) ~ 17.173s 18.005s p=0.378 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,396,619 1,396,619 ~ ~ ~ p=1.000 n=6
Types 442,163 442,163 ~ ~ ~ p=1.000 n=6
Memory Used 1,639,606k (± 0.29%) 1,637,942k (± 0.14%) ~ 1,634,892k 1,640,696k p=0.689 n=6
Memory Allocs 57,323,600 (± 0.08%) 57,320,996 (± 0.09%) ~ 57,220,858 57,366,469 p=0.689 n=6
Config Time 0.024s (±20.45%) 0.024s (±28.11%) ~ 0.013s 0.033s p=0.936 n=6
Parse Time 0.269s (± 2.00%) 0.269s (± 4.51%) ~ 0.254s 0.285s p=0.748 n=6
Bind Time 0.000s (±244.70%) 0.000s (±244.70%) ~ 0.000s 0.001s p=1.000 n=6
Check Time 2.689s (± 0.93%) 2.681s (± 0.82%) ~ 2.650s 2.702s p=0.810 n=6
Emit Time 0.267s (± 3.75%) 0.264s (± 2.44%) ~ 0.255s 0.272s p=0.574 n=6
Total Time 33.736s (± 0.65%) 33.665s (± 0.83%) ~ 33.203s 33.918s p=0.810 n=6
self-build-src-public-api - native
Errors 0 0 ~ ~ ~ p=NaN n=0
Symbols 0 0 ~ ~ ~ p=NaN n=0
Types 0 0 ~ ~ ~ p=NaN n=0
Memory Used 0k 0k ~ ~ ~ p=NaN n=0
Memory Allocs 0 0 ~ ~ ~ p=NaN n=0
Config Time 0s 0s ~ ~ ~ p=NaN n=0
Parse Time 0s 0s ~ ~ ~ p=NaN n=0
Bind Time 0s 0s ~ ~ ~ p=NaN n=0
Check Time 0s 0s ~ ~ ~ p=NaN n=0
Emit Time 0s 0s ~ ~ ~ p=NaN n=0
Total Time 0s 0s ~ ~ ~ p=NaN n=0
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 338,176 338,176 ~ ~ ~ p=1.000 n=6
Types 199,525 199,525 ~ ~ ~ p=1.000 n=6
Memory Used 330,623k (± 0.05%) 330,514k (± 0.03%) ~ 330,458k 330,700k p=0.575 n=6
Memory Allocs 2,552,441 (± 0.04%) 2,551,297 (± 0.03%) -1,144 (- 0.04%) 2,550,231 2,552,275 p=0.045 n=6
Config Time 0.001s (±34.96%) 0.001s (±38.69%) ~ 0.001s 0.002s p=0.595 n=6
Parse Time 0.135s (± 6.57%) 0.130s (± 5.99%) ~ 0.122s 0.140s p=0.335 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 1.381s (± 1.22%) 1.386s (± 0.84%) ~ 1.374s 1.407s p=0.423 n=6
Emit Time 0.085s (±15.63%) 0.089s (±12.07%) ~ 0.078s 0.108s p=0.374 n=6
Total Time 1.653s (± 1.07%) 1.656s (± 1.06%) ~ 1.640s 1.684s p=0.810 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 752 752 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory Used 103,282k (± 0.02%) 103,303k (± 0.05%) ~ 103,251k 103,381k p=1.000 n=6
Memory Allocs 110,863 (± 0.39%) 110,770 (± 0.26%) ~ 110,479 111,159 p=0.810 n=6
Config Time 0.001s (±48.94%) 0.001s (±48.94%) ~ 0.000s 0.001s p=1.000 n=6
Parse Time 0.117s (± 2.20%) 0.116s (± 3.08%) ~ 0.112s 0.122s p=0.294 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.118s (± 2.23%) 0.116s (± 3.24%) ~ 0.112s 0.123s p=0.369 n=6
vscode - native
Errors 193 193 ~ ~ ~ p=1.000 n=6
Symbols 6,005,099 6,005,099 ~ ~ ~ p=1.000 n=6
Types 2,278,551 2,278,551 ~ ~ ~ p=1.000 n=6
Memory Used 4,093,818k (± 0.03%) 4,094,191k (± 0.02%) ~ 4,093,296k 4,095,510k p=0.173 n=6
Memory Allocs 29,804,102 (± 0.11%) 29,807,205 (± 0.06%) ~ 29,790,973 29,833,584 p=0.230 n=6
Config Time 0.090s (±12.64%) 0.101s (±11.54%) ~ 0.085s 0.116s p=0.149 n=6
Parse Time 0.711s (± 4.91%) 0.687s (± 3.58%) ~ 0.647s 0.717s p=0.471 n=6
Bind Time 0.106s (± 2.44%) 0.129s (±30.82%) ~ 0.104s 0.202s p=0.372 n=6
Check Time 7.002s (± 0.28%) 7.092s (± 1.29%) ~ 7.002s 7.223s p=0.127 n=6
Emit Time 1.897s (± 4.59%) 1.656s (±16.68%) ~ 1.365s 1.943s p=0.066 n=6
Total Time 9.822s (± 0.63%) 9.687s (± 1.81%) ~ 9.447s 9.887s p=0.173 n=6
webpack - native
Errors 1,142 1,142 ~ ~ ~ p=1.000 n=6
Symbols 692,064 692,064 ~ ~ ~ p=1.000 n=6
Types 327,184 327,184 ~ ~ ~ p=1.000 n=6
Memory Used 546,706k (± 0.03%) 546,742k (± 0.02%) ~ 546,555k 546,860k p=0.378 n=6
Memory Allocs 4,184,539 (± 0.28%) 4,183,713 (± 0.21%) ~ 4,176,424 4,200,251 p=0.810 n=6
Config Time 0.014s (±26.02%) 0.016s (± 4.99%) ~ 0.015s 0.017s p=0.277 n=6
Parse Time 0.139s (± 7.37%) 0.139s (± 3.99%) ~ 0.134s 0.149s p=0.810 n=6
Bind Time 0.035s (±28.65%) 0.031s (±36.31%) ~ 0.022s 0.050s p=0.334 n=6
Check Time 1.028s (± 0.32%) 1.029s (± 0.81%) ~ 1.019s 1.042s p=0.873 n=6
Emit Time 0.001s 0.001s (±34.96%) ~ 0.001s 0.002s p=0.405 n=6
Total Time 1.237s (± 0.65%) 1.236s (± 1.37%) ~ 1.212s 1.253s p=0.748 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 991,165 991,165 ~ ~ ~ p=1.000 n=6
Types 350,724 350,724 ~ ~ ~ p=1.000 n=6
Memory Used 599,553k (± 0.01%) 599,500k (± 0.01%) ~ 599,422k 599,561k p=0.173 n=6
Memory Allocs 4,937,254 (± 0.16%) 4,936,728 (± 0.20%) ~ 4,925,544 4,951,835 p=0.936 n=6
Config Time 0.004s 0.004s ~ ~ ~ p=1.000 n=6
Parse Time 0.123s (± 3.38%) 0.123s (± 9.16%) ~ 0.105s 0.134s p=0.748 n=6
Bind Time 0.028s (±21.91%) 0.027s (±26.63%) ~ 0.020s 0.039s p=0.687 n=6
Check Time 0.970s (± 0.57%) 0.963s (± 0.82%) ~ 0.952s 0.973s p=0.142 n=6
Emit Time 0.001s (±77.38%) 0.000s (±154.76%) ~ 0.000s 0.001s p=0.311 n=6
Total Time 1.129s (± 0.81%) 1.122s (± 1.56%) ~ 1.100s 1.139s p=0.468 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-build-src-public-api - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

lsp

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsLSP - native
Req 1 - updateOpen 9ms 9ms (± 4.45%) ~ 9ms 10ms p=0.405 n=6
Req 2 - geterr 967ms (± 0.60%) 965ms (± 1.22%) ~ 951ms 982ms p=0.936 n=6
Req 3 - references 28ms (± 6.32%) 29ms (±12.09%) ~ 26ms 35ms p=0.864 n=6
Req 4 - navto 16ms (± 9.21%) 16ms (± 6.32%) ~ 15ms 18ms p=0.867 n=6
CompilerLSP - native
Req 1 - updateOpen 10ms 10ms ~ ~ ~ p=1.000 n=6
Req 2 - geterr 437ms (± 1.29%) 440ms (± 2.24%) ~ 426ms 448ms p=0.468 n=6
Req 3 - references 32ms (± 4.17%) 33ms (±11.48%) ~ 31ms 41ms p=0.676 n=6
Req 4 - navto 18ms (± 3.13%) 19ms (±10.83%) ~ 18ms 23ms p=0.054 n=6
System info unknown
Hosts
  • native
Scenarios
  • CompilerLSP - native
  • Compiler-UnionsLSP - native
  • xstate-main-1-LSP - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
lsp-startup - native
Execution time 4.64ms (±516.55%) 4.64ms (±516.54%) -0.00ms (- 0.08%) 0.00ms 464.71ms p=0.006 n=600
tsc-startup - native
Execution time 5.75ms (±516.55%) 5.69ms (±516.54%) -0.07ms (- 1.15%) 0.00ms 573.61ms p=0.000 n=600
System info unknown
Hosts
  • native
Scenarios
  • lsp-startup - native
  • tsc-startup - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@typescript-bot
Copy link
Copy Markdown

@iisaduan
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,806 (± 0.04%) 81,819 (± 0.01%) ~ 81,808 81,836 p=0.688 n=6
Types 98,821 98,821 ~ ~ ~ p=1.000 n=6
Memory Used 174,943k (± 0.05%) 174,955k (± 0.08%) ~ 174,793k 175,145k p=1.000 n=6
Memory Allocs 1,771,679 (± 0.01%) 1,771,504 (± 0.01%) ~ 1,771,123 1,771,839 p=0.230 n=6
Config Time 0.000s 0.000s (±244.70%) ~ 0.000s 0.001s p=0.405 n=6
Parse Time 0.062s (± 4.62%) 0.065s (±10.23%) ~ 0.059s 0.073s p=0.744 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 1.008s (± 1.78%) 1.012s (± 1.69%) ~ 0.992s 1.033s p=0.688 n=6
Total Time 1.070s (± 1.66%) 1.077s (± 1.88%) ~ 1.052s 1.106s p=0.575 n=6
angular-1 - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 884,933 (± 0.08%) 884,918 (± 0.05%) ~ 884,088 885,364 p=0.575 n=6
Types 263,843 (± 0.00%) 263,843 (± 0.00%) ~ 263,842 263,845 p=0.801 n=6
Memory Used 835,493k (± 0.05%) 835,397k (± 0.07%) ~ 834,837k 836,077k p=0.689 n=6
Memory Allocs 6,725,022 (± 0.53%) 6,711,949 (± 0.15%) ~ 6,703,060 6,725,351 p=0.810 n=6
Config Time 0.039s (± 7.53%) 0.044s (± 6.42%) 🔻+0.005s (+12.45%) 0.039s 0.047s p=0.019 n=6
Parse Time 0.252s (± 2.40%) 0.251s (± 4.61%) ~ 0.232s 0.264s p=0.936 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 2.066s (± 0.50%) 2.066s (± 0.70%) ~ 2.041s 2.081s p=0.873 n=6
Total Time 2.359s (± 0.54%) 2.363s (± 0.57%) ~ 2.348s 2.383s p=0.689 n=6
mui-docs - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 3,805,864 3,805,864 ~ ~ ~ p=1.000 n=6
Types 1,464,080 1,464,080 ~ ~ ~ p=1.000 n=6
Memory Used 4,460,622k (± 0.05%) 4,460,478k (± 0.01%) ~ 4,459,873k 4,461,607k p=0.810 n=6
Memory Allocs 98,822,062 (±14.50%) 96,030,950 (±22.72%) ~ 66,734,366 124,475,514 p=0.936 n=6
Config Time 0.033s (±10.83%) 0.029s (± 7.67%) ~ 0.027s 0.033s p=0.075 n=6
Parse Time 1.243s (±16.16%) 1.194s (±29.71%) ~ 0.777s 1.730s p=0.810 n=6
Bind Time 0.002s 0.002s ~ ~ ~ p=1.000 n=6
Check Time 15.305s (± 0.83%) 15.253s (± 0.40%) ~ 15.169s 15.320s p=0.575 n=6
Emit Time 0.525s (± 6.32%) 0.564s (±22.44%) ~ 0.496s 0.818s p=0.630 n=6
Total Time 17.638s (± 1.28%) 17.558s (± 1.82%) ~ 17.214s 18.108s p=0.575 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,396,619 1,396,619 ~ ~ ~ p=1.000 n=6
Types 442,163 442,163 ~ ~ ~ p=1.000 n=6
Memory Used 1,639,655k (± 0.51%) 1,632,691k (± 0.37%) ~ 1,624,833k 1,641,336k p=0.128 n=6
Memory Allocs 57,295,164 (± 0.13%) 57,266,884 (± 0.09%) ~ 57,174,145 57,316,131 p=0.471 n=6
Config Time 0.025s (±13.32%) 0.023s (±24.00%) ~ 0.015s 0.031s p=0.574 n=6
Parse Time 0.265s (± 3.06%) 0.265s (± 1.76%) ~ 0.259s 0.271s p=0.810 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 2.680s (± 0.98%) 2.689s (± 0.95%) ~ 2.665s 2.738s p=0.575 n=6
Emit Time 0.260s (± 1.73%) 0.267s (± 3.99%) ~ 0.253s 0.278s p=0.336 n=6
Total Time 33.673s (± 0.67%) 33.718s (± 0.81%) ~ 33.466s 34.135s p=0.936 n=6
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 338,176 338,176 ~ ~ ~ p=1.000 n=6
Types 199,525 199,525 ~ ~ ~ p=1.000 n=6
Memory Used 330,537k (± 0.02%) 330,485k (± 0.05%) ~ 330,337k 330,765k p=0.230 n=6
Memory Allocs 2,551,934 (± 0.04%) 2,551,633 (± 0.04%) ~ 2,550,454 2,553,301 p=0.471 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.134s (± 2.14%) 0.134s (± 4.28%) ~ 0.126s 0.140s p=0.746 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 1.374s (± 1.00%) 1.386s (± 0.98%) ~ 1.373s 1.411s p=0.078 n=6
Emit Time 0.082s (± 2.98%) 0.081s (± 7.11%) ~ 0.076s 0.092s p=0.374 n=6
Total Time 1.644s (± 0.74%) 1.659s (± 0.82%) ~ 1.643s 1.675s p=0.066 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 752 752 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory Used 103,307k (± 0.02%) 103,283k (± 0.02%) ~ 103,239k 103,309k p=0.230 n=6
Memory Allocs 110,914 (± 0.24%) 110,666 (± 0.14%) ~ 110,476 110,820 p=0.230 n=6
Config Time 0.001s (±48.94%) 0.001s (±77.38%) ~ 0.000s 0.001s p=0.595 n=6
Parse Time 0.117s (± 3.17%) 0.118s (± 5.04%) ~ 0.112s 0.129s p=1.000 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.118s (± 3.14%) 0.119s (± 5.00%) ~ 0.113s 0.130s p=1.000 n=6
vscode - native
Errors 193 193 ~ ~ ~ p=1.000 n=6
Symbols 6,005,298 6,005,298 ~ ~ ~ p=1.000 n=6
Types 2,278,710 2,278,710 ~ ~ ~ p=1.000 n=6
Memory Used 4,094,216k (± 0.04%) 4,093,552k (± 0.02%) ~ 4,092,323k 4,094,882k p=0.575 n=6
Memory Allocs 29,809,782 (± 0.08%) 29,806,621 (± 0.06%) ~ 29,795,778 29,837,959 p=0.936 n=6
Config Time 0.092s (±10.05%) 0.104s (± 3.76%) ~ 0.099s 0.110s p=0.054 n=6
Parse Time 0.664s (± 4.09%) 0.672s (± 3.72%) ~ 0.645s 0.708s p=0.575 n=6
Bind Time 0.135s (±27.77%) 0.119s (±16.77%) ~ 0.104s 0.148s p=0.574 n=6
Check Time 7.063s (± 1.00%) 7.114s (± 1.52%) ~ 6.976s 7.297s p=0.575 n=6
Emit Time 1.670s (±16.75%) 1.659s (±17.76%) ~ 1.368s 1.963s p=0.810 n=6
Total Time 9.649s (± 2.13%) 9.689s (± 2.21%) ~ 9.460s 9.915s p=0.575 n=6
webpack - native
Errors 1,142 1,142 ~ ~ ~ p=1.000 n=6
Symbols 692,064 692,064 ~ ~ ~ p=1.000 n=6
Types 327,184 327,184 ~ ~ ~ p=1.000 n=6
Memory Used 546,809k (± 0.03%) 546,730k (± 0.04%) ~ 546,489k 547,144k p=0.298 n=6
Memory Allocs 4,182,118 (± 0.16%) 4,186,231 (± 0.26%) ~ 4,175,869 4,201,115 p=0.689 n=6
Config Time 0.011s (±24.09%) 0.013s (±16.21%) ~ 0.009s 0.015s p=0.255 n=6
Parse Time 0.145s (± 4.87%) 0.151s (± 3.66%) ~ 0.143s 0.158s p=0.108 n=6
Bind Time 0.031s (±24.42%) 0.026s (±10.35%) ~ 0.024s 0.030s p=0.221 n=6
Check Time 1.028s (± 1.00%) 1.040s (± 1.23%) ~ 1.026s 1.057s p=0.128 n=6
Emit Time 0.001s (±38.69%) 0.001s ~ ~ ~ p=0.174 n=6
Total Time 1.238s (± 0.48%) 1.253s (± 0.97%) +0.014s (+ 1.16%) 1.238s 1.273s p=0.030 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 991,165 991,165 ~ ~ ~ p=1.000 n=6
Types 350,724 350,724 ~ ~ ~ p=1.000 n=6
Memory Used 599,877k (± 0.01%) 599,899k (± 0.02%) ~ 599,812k 600,080k p=0.689 n=6
Memory Allocs 4,953,228 (± 0.13%) 4,946,256 (± 0.05%) ~ 4,944,268 4,950,901 p=0.128 n=6
Config Time 0.006s (±31.87%) 0.006s (±29.50%) ~ 0.004s 0.008s p=0.611 n=6
Parse Time 0.140s (± 3.84%) 0.133s (± 5.80%) ~ 0.121s 0.142s p=0.172 n=6
Bind Time 0.029s (±22.64%) 0.036s (±23.07%) ~ 0.027s 0.046s p=0.125 n=6
Check Time 1.133s (± 1.69%) 1.113s (± 0.60%) -0.020s (- 1.74%) 1.106s 1.123s p=0.045 n=6
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Total Time 1.313s (± 1.23%) 1.292s (± 0.41%) -0.021s (- 1.60%) 1.286s 1.300s p=0.025 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

lsp

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsLSP - native
Req 1 - updateOpen 9ms (± 8.74%) 9ms ~ ~ ~ p=0.405 n=6
Req 2 - geterr 958ms (± 1.17%) 959ms (± 0.57%) ~ 952ms 967ms p=0.574 n=6
Req 3 - references 29ms (±14.27%) 27ms (± 1.52%) ~ 26ms 27ms p=0.787 n=6
Req 4 - navto 17ms (±17.82%) 16ms (± 8.36%) ~ 15ms 19ms p=1.000 n=6
CompilerLSP - native
Req 1 - updateOpen 13ms (± 6.87%) 14ms (±12.80%) ~ 12ms 17ms p=0.673 n=6
Req 2 - geterr 518ms (± 1.66%) 520ms (± 1.82%) ~ 504ms 530ms p=0.810 n=6
Req 3 - references 38ms (± 4.94%) 37ms (± 7.03%) ~ 34ms 41ms p=0.460 n=6
Req 4 - navto 21ms (± 4.08%) 21ms (± 7.89%) ~ 20ms 24ms p=0.485 n=6
System info unknown
Hosts
  • native
Scenarios
  • CompilerLSP - native
  • Compiler-UnionsLSP - native
  • xstate-main-1-LSP - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
lsp-startup - native
Execution time 5.69ms (±516.54%) 5.72ms (±516.55%) +0.03ms (+ 0.56%) 0.00ms 575.85ms p=0.000 n=600
tsgo-startup - native
Execution time 5.74ms (±516.55%) 5.73ms (±516.54%) -0.01ms (- 0.17%) 0.00ms 575.35ms p=0.000 n=600
System info unknown
Hosts
  • native
Scenarios
  • lsp-startup - native
  • tsgo-startup - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

@iisaduan
Copy link
Copy Markdown
Member Author

iisaduan commented Apr 6, 2026

@typescript-bot perf test this

@typescript-bot
Copy link
Copy Markdown

typescript-bot commented Apr 6, 2026

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this ✅ Started 👀 Results

@typescript-bot
Copy link
Copy Markdown

@iisaduan
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,791 (± 0.04%) 81,795 (± 0.03%) ~ 81,777 81,822 p=0.871 n=6
Types 98,821 98,821 ~ ~ ~ p=1.000 n=6
Memory Used 174,938k (± 0.06%) 174,951k (± 0.06%) ~ 174,845k 175,137k p=0.689 n=6
Memory Allocs 1,771,742 (± 0.01%) 1,771,726 (± 0.01%) ~ 1,771,479 1,772,063 p=1.000 n=6
Config Time 0.000s (±244.70%) 0.000s ~ ~ ~ p=0.405 n=6
Parse Time 0.064s (± 7.40%) 0.063s (± 6.67%) ~ 0.060s 0.071s p=0.871 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 1.000s (± 0.74%) 1.012s (± 1.63%) ~ 0.992s 1.036s p=0.261 n=6
Total Time 1.065s (± 0.78%) 1.076s (± 1.51%) ~ 1.061s 1.101s p=0.295 n=6
angular-1 - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 884,234 (± 0.08%) 884,690 (± 0.11%) ~ 883,373 885,735 p=0.378 n=6
Types 263,843 (± 0.00%) 263,843 (± 0.00%) ~ 263,842 263,845 p=0.676 n=6
Memory Used 835,158k (± 0.06%) 835,550k (± 0.08%) ~ 834,807k 836,590k p=0.471 n=6
Memory Allocs 6,723,411 (± 0.36%) 6,727,436 (± 0.24%) ~ 6,706,581 6,743,750 p=0.936 n=6
Config Time 0.041s (±12.98%) 0.040s (±13.68%) ~ 0.035s 0.048s p=0.570 n=6
Parse Time 0.251s (± 3.06%) 0.246s (± 3.36%) ~ 0.234s 0.258s p=0.377 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 2.041s (± 1.01%) 2.043s (± 0.81%) ~ 2.018s 2.068s p=0.748 n=6
Total Time 2.334s (± 0.87%) 2.330s (± 0.73%) ~ 2.307s 2.349s p=1.000 n=6
mui-docs - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 3,805,864 3,805,864 ~ ~ ~ p=1.000 n=6
Types 1,464,080 1,464,080 ~ ~ ~ p=1.000 n=6
Memory Used 4,460,105k (± 0.01%) 4,461,721k (± 0.07%) ~ 4,459,180k 4,466,953k p=0.471 n=6
Memory Allocs 85,620,056 (±19.32%) 91,692,723 (±20.83%) ~ 74,576,273 116,569,361 p=0.471 n=6
Config Time 0.030s (±15.01%) 0.033s (± 7.48%) ~ 0.031s 0.038s p=0.063 n=6
Parse Time 1.036s (±24.53%) 1.139s (±28.72%) ~ 0.844s 1.592s p=0.471 n=6
Bind Time 0.002s (±18.82%) 0.002s ~ ~ ~ p=0.405 n=6
Check Time 15.217s (± 0.29%) 15.203s (± 0.75%) ~ 15.084s 15.383s p=0.689 n=6
Emit Time 0.545s (± 6.12%) 0.551s (± 4.66%) ~ 0.503s 0.569s p=0.936 n=6
Total Time 17.289s (± 1.84%) 17.439s (± 2.36%) ~ 17.005s 17.987s p=0.378 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,396,619 1,396,619 ~ ~ ~ p=1.000 n=6
Types 442,163 442,163 ~ ~ ~ p=1.000 n=6
Memory Used 1,638,294k (± 0.29%) 1,638,285k (± 0.17%) ~ 1,636,008k 1,643,462k p=0.810 n=6
Memory Allocs 57,350,581 (± 0.12%) 57,328,670 (± 0.09%) ~ 57,250,891 57,388,005 p=0.936 n=6
Config Time 0.022s (±21.60%) 0.024s (±12.14%) ~ 0.020s 0.027s p=0.809 n=6
Parse Time 0.267s (± 3.82%) 0.265s (± 4.25%) ~ 0.255s 0.282s p=0.630 n=6
Bind Time 0.000s 0.000s (±244.70%) ~ 0.000s 0.001s p=0.405 n=6
Check Time 2.719s (± 1.43%) 2.670s (± 0.66%) -0.050s (- 1.82%) 2.636s 2.683s p=0.020 n=6
Emit Time 0.260s (± 2.19%) 0.261s (± 5.95%) ~ 0.242s 0.287s p=0.936 n=6
Total Time 33.959s (± 1.04%) 33.475s (± 0.71%) -0.484s (- 1.43%) 33.157s 33.872s p=0.020 n=6
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 338,176 338,176 ~ ~ ~ p=1.000 n=6
Types 199,525 199,525 ~ ~ ~ p=1.000 n=6
Memory Used 330,574k (± 0.03%) 330,533k (± 0.05%) ~ 330,229k 330,770k p=0.873 n=6
Memory Allocs 2,551,571 (± 0.01%) 2,551,757 (± 0.04%) ~ 2,549,896 2,552,928 p=0.689 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.137s (± 5.09%) 0.135s (± 6.10%) ~ 0.125s 0.148s p=0.748 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 1.387s (± 1.36%) 1.389s (± 1.19%) ~ 1.372s 1.412s p=0.936 n=6
Emit Time 0.079s (± 8.58%) 0.078s (± 3.19%) ~ 0.074s 0.081s p=0.747 n=6
Total Time 1.654s (± 1.15%) 1.660s (± 1.14%) ~ 1.640s 1.688s p=0.573 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 752 752 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory Used 103,308k (± 0.03%) 103,296k (± 0.03%) ~ 103,242k 103,332k p=0.936 n=6
Memory Allocs 110,846 (± 0.31%) 110,895 (± 0.37%) ~ 110,459 111,640 p=0.936 n=6
Config Time 0.001s 0.001s (±48.94%) ~ 0.000s 0.001s p=0.405 n=6
Parse Time 0.118s (± 4.47%) 0.120s (± 3.84%) ~ 0.116s 0.128s p=0.572 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.119s (± 4.43%) 0.121s (± 3.81%) ~ 0.117s 0.129s p=0.572 n=6
vscode - native
Errors 193 193 ~ ~ ~ p=1.000 n=6
Symbols 6,005,814 6,005,814 ~ ~ ~ p=1.000 n=6
Types 2,278,895 2,278,895 ~ ~ ~ p=1.000 n=6
Memory Used 4,093,856k (± 0.03%) 4,094,802k (± 0.01%) +947k (+ 0.02%) 4,094,310k 4,095,254k p=0.045 n=6
Memory Allocs 29,806,130 (± 0.04%) 29,808,278 (± 0.05%) ~ 29,794,312 29,833,340 p=0.810 n=6
Config Time 0.130s (± 8.57%) 0.124s (± 7.41%) ~ 0.114s 0.140s p=0.421 n=6
Parse Time 0.687s (± 6.64%) 0.693s (± 2.99%) ~ 0.664s 0.719s p=1.000 n=6
Bind Time 0.155s (±47.80%) 0.144s (±38.37%) ~ 0.105s 0.219s p=1.000 n=6
Check Time 8.135s (± 1.28%) 8.105s (± 1.03%) ~ 8.036s 8.257s p=0.748 n=6
Emit Time 1.778s (± 9.07%) 1.889s (± 9.81%) ~ 1.634s 2.103s p=0.230 n=6
Total Time 10.905s (± 0.65%) 10.981s (± 1.04%) ~ 10.839s 11.104s p=0.173 n=6
webpack - native
Errors 1,142 1,142 ~ ~ ~ p=1.000 n=6
Symbols 692,064 692,064 ~ ~ ~ p=1.000 n=6
Types 327,184 327,184 ~ ~ ~ p=1.000 n=6
Memory Used 546,676k (± 0.02%) 546,795k (± 0.03%) ~ 546,604k 547,015k p=0.173 n=6
Memory Allocs 4,185,115 (± 0.23%) 4,191,447 (± 0.41%) ~ 4,179,461 4,223,810 p=0.689 n=6
Config Time 0.014s (±16.93%) 0.012s (±24.13%) ~ 0.009s 0.016s p=0.171 n=6
Parse Time 0.142s (± 3.60%) 0.140s (± 3.73%) ~ 0.132s 0.146s p=0.257 n=6
Bind Time 0.028s (±14.25%) 0.027s (±27.26%) ~ 0.022s 0.042s p=0.226 n=6
Check Time 1.037s (± 1.16%) 1.034s (± 1.48%) ~ 1.016s 1.053s p=0.748 n=6
Emit Time 0.002s (±36.48%) 0.001s ~ ~ ~ p=0.071 n=6
Total Time 1.247s (± 0.83%) 1.237s (± 1.19%) ~ 1.208s 1.248s p=0.471 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 991,165 991,165 ~ ~ ~ p=1.000 n=6
Types 350,724 350,724 ~ ~ ~ p=1.000 n=6
Memory Used 599,604k (± 0.01%) 599,542k (± 0.01%) ~ 599,430k 599,640k p=0.128 n=6
Memory Allocs 4,936,241 (± 0.09%) 4,941,716 (± 0.16%) ~ 4,932,670 4,955,879 p=0.230 n=6
Config Time 0.004s 0.004s ~ ~ ~ p=1.000 n=6
Parse Time 0.129s (± 7.23%) 0.124s (± 8.83%) ~ 0.105s 0.138s p=0.630 n=6
Bind Time 0.022s (± 8.31%) 0.029s (±30.24%) ~ 0.021s 0.039s p=0.514 n=6
Check Time 0.972s (± 0.77%) 0.966s (± 1.24%) ~ 0.949s 0.980s p=0.575 n=6
Emit Time 0.001s (±109.43%) 0.001s (±77.38%) ~ 0.000s 0.001s p=0.640 n=6
Total Time 1.130s (± 1.08%) 1.128s (± 1.58%) ~ 1.097s 1.151s p=0.809 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

lsp

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsLSP - native
Req 1 - updateOpen 9ms (± 5.53%) 9ms (± 5.53%) ~ 9ms 10ms p=1.000 n=6
Req 2 - geterr 965ms (± 0.74%) 962ms (± 1.19%) ~ 950ms 980ms p=0.521 n=6
Req 3 - references 28ms (± 8.74%) 29ms (±15.25%) ~ 26ms 35ms p=0.352 n=6
Req 4 - navto 16ms 17ms (±17.43%) ~ 15ms 23ms p=1.000 n=6
CompilerLSP - native
Req 1 - updateOpen 10ms 10ms ~ ~ ~ p=1.000 n=6
Req 2 - geterr 440ms (± 1.21%) 437ms (± 2.02%) ~ 426ms 448ms p=0.520 n=6
Req 3 - references 32ms (± 2.65%) 32ms (± 4.31%) ~ 30ms 34ms p=1.000 n=6
Req 4 - navto 18ms (± 3.51%) 18ms (± 8.81%) ~ 17ms 21ms p=0.799 n=6
System info unknown
Hosts
  • native
Scenarios
  • CompilerLSP - native
  • Compiler-UnionsLSP - native
  • xstate-main-1-LSP - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
lsp-startup - native
Execution time 4.64ms (±516.55%) 4.64ms (±516.54%) +0.00ms (+ 0.00%) 0.00ms 467.68ms p=0.000 n=600
tsgo-startup - native
Execution time 5.73ms (±516.55%) 5.73ms (±516.54%) -0.00ms (- 0.04%) 0.00ms 576.42ms p=0.000 n=600
System info unknown
Hosts
  • native
Scenarios
  • lsp-startup - native
  • tsgo-startup - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Copy Markdown

@iisaduan
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,793 (± 0.05%) 81,813 (± 0.02%) ~ 81,779 81,835 p=0.376 n=6
Types 98,821 98,821 ~ ~ ~ p=1.000 n=6
Memory Used 175,314k (± 0.06%) 175,254k (± 0.04%) ~ 175,214k 175,384k p=0.471 n=6
Memory Allocs 1,771,874 (± 0.01%) 1,771,717 (± 0.01%) -158 (- 0.01%) 1,771,634 1,772,006 p=0.045 n=6
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Parse Time 0.063s (± 4.01%) 0.064s (± 7.88%) ~ 0.058s 0.069s p=1.000 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 1.048s (± 1.71%) 1.032s (± 1.29%) ~ 1.006s 1.043s p=0.092 n=6
Total Time 1.112s (± 1.52%) 1.096s (± 1.43%) ~ 1.066s 1.108s p=0.092 n=6
angular-1 - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 885,185 (± 0.04%) 885,246 (± 0.03%) ~ 884,832 885,716 p=0.810 n=6
Types 263,843 (± 0.00%) 263,843 (± 0.00%) ~ 263,842 263,844 p=0.437 n=6
Memory Used 838,536k (± 0.05%) 838,607k (± 0.05%) ~ 838,149k 839,302k p=0.936 n=6
Memory Allocs 6,722,025 (± 0.25%) 6,726,195 (± 0.26%) ~ 6,709,525 6,748,655 p=0.378 n=6
Config Time 0.042s (±11.11%) 0.041s (±13.87%) ~ 0.036s 0.051s p=0.808 n=6
Parse Time 0.257s (± 3.22%) 0.254s (± 4.75%) ~ 0.241s 0.267s p=0.809 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 2.084s (± 0.78%) 2.070s (± 1.16%) ~ 2.029s 2.098s p=0.378 n=6
Total Time 2.384s (± 0.82%) 2.368s (± 1.21%) ~ 2.323s 2.410s p=0.377 n=6
mui-docs - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 4,258,161 4,258,161 ~ ~ ~ p=1.000 n=6
Types 1,553,366 1,553,366 ~ ~ ~ p=1.000 n=6
Memory Used 5,429,254k (± 0.02%) 5,429,108k (± 0.01%) ~ 5,428,384k 5,429,682k p=0.689 n=6
Memory Allocs 103,496,383 (±14.67%) 110,365,113 (±15.77%) ~ 83,745,907 132,390,074 p=0.575 n=6
Config Time 0.029s (± 5.96%) 0.033s (±12.10%) ~ 0.027s 0.038s p=0.164 n=6
Parse Time 1.170s (±21.87%) 1.255s (±21.20%) ~ 0.847s 1.581s p=0.689 n=6
Bind Time 0.002s (±22.11%) 0.002s ~ ~ ~ p=0.174 n=6
Check Time 19.120s (± 0.74%) 19.118s (± 0.36%) ~ 19.039s 19.196s p=0.810 n=6
Emit Time 0.528s (± 3.95%) 0.536s (± 0.55%) ~ 0.532s 0.539s p=0.418 n=6
Total Time 21.266s (± 2.04%) 21.340s (± 1.34%) ~ 20.851s 21.677s p=0.689 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,396,619 1,396,619 ~ ~ ~ p=1.000 n=6
Types 442,163 442,163 ~ ~ ~ p=1.000 n=6
Memory Used 1,650,870k (± 0.08%) 1,649,110k (± 0.31%) ~ 1,641,206k 1,655,946k p=0.298 n=6
Memory Allocs 57,343,234 (± 0.06%) 57,287,432 (± 0.08%) -55,802 (- 0.10%) 57,226,182 57,349,471 p=0.045 n=6
Config Time 0.025s (±18.01%) 0.025s (±11.77%) ~ 0.021s 0.028s p=1.000 n=6
Parse Time 0.263s (± 2.84%) 0.266s (± 2.43%) ~ 0.260s 0.276s p=0.630 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 2.714s (± 1.12%) 2.713s (± 0.74%) ~ 2.687s 2.743s p=1.000 n=6
Emit Time 0.264s (± 1.64%) 0.263s (± 3.01%) ~ 0.249s 0.271s p=1.000 n=6
Total Time 33.966s (± 0.57%) 33.905s (± 0.66%) ~ 33.587s 34.122s p=0.575 n=6
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 338,176 338,176 ~ ~ ~ p=1.000 n=6
Types 199,525 199,525 ~ ~ ~ p=1.000 n=6
Memory Used 331,946k (± 0.03%) 331,855k (± 0.03%) ~ 331,751k 331,987k p=0.128 n=6
Memory Allocs 2,551,925 (± 0.01%) 2,552,293 (± 0.02%) ~ 2,551,685 2,552,979 p=0.230 n=6
Config Time 0.001s 0.001s (±34.96%) ~ 0.001s 0.002s p=0.405 n=6
Parse Time 0.132s (± 5.78%) 0.132s (± 5.29%) ~ 0.127s 0.144s p=0.628 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 1.402s (± 1.90%) 1.399s (± 1.22%) ~ 1.378s 1.421s p=0.936 n=6
Emit Time 0.080s (± 4.48%) 0.080s (± 4.40%) ~ 0.076s 0.084s p=0.808 n=6
Total Time 1.670s (± 1.67%) 1.666s (± 1.04%) ~ 1.649s 1.694s p=1.000 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 752 752 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory Used 104,615k (± 0.04%) 104,618k (± 0.01%) ~ 104,593k 104,631k p=0.748 n=6
Memory Allocs 110,661 (± 0.16%) 110,659 (± 0.31%) ~ 110,427 111,351 p=0.471 n=6
Config Time 0.001s 0.000s (±154.76%) 🟩-0.001s (-66.67%) 0.000s 0.001s p=0.025 n=6
Parse Time 0.120s (± 3.49%) 0.115s (± 3.77%) ~ 0.108s 0.121s p=0.076 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.121s (± 3.46%) 0.116s (± 3.81%) ~ 0.109s 0.122s p=0.087 n=6
vscode - native
Errors 193 193 ~ ~ ~ p=1.000 n=6
Symbols 6,091,561 6,091,561 ~ ~ ~ p=1.000 n=6
Types 2,304,610 2,304,610 ~ ~ ~ p=1.000 n=6
Memory Used 4,146,927k (± 0.04%) 4,146,225k (± 0.03%) ~ 4,144,943k 4,147,640k p=0.575 n=6
Memory Allocs 30,094,471 (± 0.04%) 30,111,297 (± 0.09%) ~ 30,081,534 30,157,961 p=0.298 n=6
Config Time 0.122s (± 5.26%) 0.124s (± 9.26%) ~ 0.108s 0.139s p=0.747 n=6
Parse Time 0.680s (± 6.11%) 0.723s (± 3.67%) ~ 0.697s 0.768s p=0.128 n=6
Bind Time 0.171s (±40.48%) 0.114s (± 8.52%) ~ 0.109s 0.134s p=0.196 n=6
Check Time 8.417s (± 0.28%) 8.423s (± 0.77%) ~ 8.359s 8.510s p=0.689 n=6
Emit Time 1.910s (± 9.44%) 1.930s (±11.36%) ~ 1.626s 2.104s p=0.936 n=6
Total Time 11.327s (± 1.10%) 11.337s (± 1.49%) ~ 11.102s 11.467s p=1.000 n=6
webpack - native
Errors 1,149 1,149 ~ ~ ~ p=1.000 n=6
Symbols 699,638 699,638 ~ ~ ~ p=1.000 n=6
Types 334,179 334,179 ~ ~ ~ p=1.000 n=6
Memory Used 553,070k (± 0.02%) 552,964k (± 0.02%) ~ 552,811k 553,189k p=0.128 n=6
Memory Allocs 4,243,380 (± 0.25%) 4,263,277 (± 0.73%) ~ 4,233,327 4,317,817 p=0.230 n=6
Config Time 0.008s 0.008s (± 6.19%) ~ 0.008s 0.009s p=0.174 n=6
Parse Time 0.129s (± 9.95%) 0.130s (± 4.84%) ~ 0.122s 0.139s p=0.936 n=6
Bind Time 0.027s (±31.01%) 0.023s (±22.04%) ~ 0.018s 0.031s p=0.368 n=6
Check Time 1.013s (± 1.86%) 1.008s (± 0.76%) ~ 1.001s 1.022s p=0.575 n=6
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Total Time 1.194s (± 1.80%) 1.187s (± 0.90%) ~ 1.177s 1.202s p=0.810 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 991,165 991,165 ~ ~ ~ p=1.000 n=6
Types 350,724 350,724 ~ ~ ~ p=1.000 n=6
Memory Used 603,277k (± 0.01%) 603,254k (± 0.01%) ~ 603,180k 603,366k p=0.471 n=6
Memory Allocs 4,951,099 (± 0.23%) 4,946,323 (± 0.16%) ~ 4,936,651 4,957,315 p=0.378 n=6
Config Time 0.008s (± 4.99%) 0.007s (±22.11%) ~ 0.005s 0.009s p=0.209 n=6
Parse Time 0.136s (± 3.32%) 0.141s (± 4.50%) ~ 0.131s 0.150s p=0.078 n=6
Bind Time 0.029s (±28.87%) 0.032s (±21.97%) ~ 0.026s 0.044s p=0.226 n=6
Check Time 1.134s (± 0.61%) 1.129s (± 0.79%) ~ 1.119s 1.141s p=0.378 n=6
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Total Time 1.312s (± 0.53%) 1.315s (± 0.40%) ~ 1.311s 1.324s p=0.568 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

lsp

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsLSP - native
Req 1 - updateOpen 9ms (± 4.45%) 9ms ~ ~ ~ p=0.405 n=6
Req 2 - geterr 981ms (± 1.06%) 977ms (± 1.33%) ~ 967ms 999ms p=0.332 n=6
Req 3 - references 39ms (± 9.39%) 41ms (±19.50%) ~ 36ms 56ms p=0.871 n=6
Req 4 - navto 16ms (± 2.52%) 17ms (±10.89%) ~ 15ms 20ms p=0.849 n=6
Req 5 - completionInfo count 1,357 1,357 ~ ~ ~ p=1.000 n=6
Req 5 - completionInfo 16ms (±16.71%) 15ms (±11.14%) ~ 13ms 17ms p=0.259 n=6
CompilerLSP - native
Req 1 - updateOpen 10ms 10ms ~ ~ ~ p=1.000 n=6
Req 2 - geterr 440ms (± 1.63%) 442ms (± 1.25%) ~ 436ms 449ms p=0.936 n=6
Req 3 - references 47ms (± 6.24%) 48ms (± 4.72%) ~ 46ms 52ms p=0.869 n=6
Req 4 - navto 17ms (± 4.47%) 16ms (± 3.16%) ~ 16ms 17ms p=0.247 n=6
Req 5 - completionInfo count 1,519 1,519 ~ ~ ~ p=1.000 n=6
Req 5 - completionInfo 21ms (±13.49%) 21ms (±19.67%) ~ 15ms 26ms p=0.935 n=6
System info unknown
Hosts
  • native
Scenarios
  • CompilerLSP - native
  • Compiler-UnionsLSP - native
  • xstate-main-1-LSP - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
lsp-startup - native
Execution time 4.70ms (±516.54%) 4.70ms (±516.55%) +0.00ms (+ 0.02%) 0.00ms 475.38ms p=0.000 n=600
tsgo-startup - native
Execution time 5.79ms (±516.54%) 5.78ms (±516.55%) -0.01ms (- 0.21%) 0.00ms 583.18ms p=0.000 n=600
System info unknown
Hosts
  • native
Scenarios
  • lsp-startup - native
  • tsgo-startup - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Copy Markdown

@iisaduan, the perf run you requested failed. You can check the log here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants