Improve benchmarking suite

[quantizor]

Now with memory info:

Memory Usage Summary:
  init: 1.57 MB heap
  simple: 1016.39 KB heap
  heavy: 1.01 MB heap
  collection with cache: 2.52 MB heap
    Total footprint: 234.75 MB
    Operations: 1322
  collection without cache: 16.99 MB heap
    Total footprint: 235.13 MB
    Operations: 1322


 ✓ tests/tw-merge.benchmark.ts > twMerge 3136ms
     name                            hz     min      max    mean     p75      p99     p995     p999     rme  samples
   · init                      4,065.35  0.2175   1.8490  0.2460  0.2450   0.4969   0.5517   0.8136  ±1.12%     2033
   · simple                    4,062.11  0.2270   0.7383  0.2462  0.2448   0.4628   0.4756   0.5714  ±0.70%     2032
   · heavy                     3,837.87  0.2374   2.3023  0.2606  0.2597   0.4791   0.5047   0.8659  ±1.06%     1919
   · collection with cache       688.97  1.3773   2.2432  1.4514  1.4654   1.7979   1.9276   2.2432  ±0.68%      345
   · collection without cache    109.09  8.8340  10.2709  9.1664  9.2940  10.2709  10.2709  10.2709  ±0.73%       55

The benchmark data should be a bit more accurate as well with some random memory fluctuations removed.

[quantizor]

Need some more tweaks here, the gc method is not being properly exposed so we're missing the per-test stabilization done

[codspeed-hq]

CodSpeed Performance Report

Merging #620 will not alter performance

_{Comparing quantizor:improve-benchmarking-suite (13c02a6) with main (660b993)}

Summary

✅ 5 untouched

[dcastil]

Nice, this is really cool! Thanks for the addition! Let's just fix the last ESLint issue so we can merge this.

[quantizor]

Oh yeah it can just be removed

…

On Sun, Nov 2, 2025 at 9:04 AM Dany Castillo ***@***.***> wrote: ***@***.**** approved this pull request. Nice, this is really cool! Thanks for the addition! Let's just fix the last ESLint issue so we can merge this. ------------------------------ In tests/tw-merge.benchmark.ts <#620 (comment)> : > + */ +async function forceGarbageCollection(): Promise<void> { + if (typeof globalThis.gc === 'function') { + await globalThis.gc() + } else { + // eslint-disable-next-line no-console -- This is a warning that will be printed to the console if garbage collection is not exposed. + console.warn( + 'Garbage collection not exposed. Run with --expose-gc for accurate memory measurements.', + ) + } +} + +// Guard to ensure memory summary is printed exactly once. teardown() runs after every +// benchmark iteration, so without this guard the summary would be printed multiple times +// (once per iteration of the last benchmark). +let summaryPrinted = false Looks like this variable is not used anywhere. Maybe forgot to add the logic or forgot to remove? — Reply to this email directly, view it on GitHub <#620 (review)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAELFVRVHXVGPEFOZZDYM7D32YFPTAVCNFSM6AAAAACKS2BC22VHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZTIMBYHAYDKMJVHE> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[dcastil]

Alright, let me remove it

[dcastil]

FYI I also added two commits:

• Removed variable benchWithMemory which didn't seem to be used in 7848c8b
• Moved all the helper code below the test suite to stay consistent with rest of codebase in 13c02a6

[github-actions]

This was addressed in release v3.4.0.