Update CodSpeed

[MarshalX]

No description provided.

[codspeed-hq]

CodSpeed Performance Report

Merging #81 will create unknown performance changes

_{Comparing update-codspeed (861a816) with main (53b68cd)}

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Summary

🆕 192 new
⏩ 192 skipped¹

Benchmarks breakdown

	Mode	Benchmark	BASE	HEAD	Change
🆕	WallTime	test_dag_cbor_decode[roundtrip01.json]	N/A	286.7 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip02.json]	N/A	286 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip03.json]	N/A	288.3 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip04.json]	N/A	292.7 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip05.json]	N/A	388.4 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip06.json]	N/A	245.4 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip07.json]	N/A	243.7 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip08.json]	N/A	304.8 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip09.json]	N/A	538 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip10.json]	N/A	680.8 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip11.json]	N/A	324.9 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip12.json]	N/A	344.9 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip13.json]	N/A	343.1 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip14.json]	N/A	345.3 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip15.json]	N/A	294.5 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip16.json]	N/A	316.1 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip17.json]	N/A	320.2 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip18.json]	N/A	314.5 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip19.json]	N/A	317.4 ns	N/A
🆕	WallTime	test_dag_cbor_decode[roundtrip20.json]	N/A	306.7 ns	N/A
...	...	...	...	...	...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Footnotes

1. 192 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

[MarshalX]

Notes:

The 'instrumentation' runner mode is deprecated and will be removed in a future version. Please use 'simulation' instead.

and

4 workers [192 items]

but

================================ 0 benchmarked =================================
======================== 192 passed in 83.03s (0:01:23) ========================

I do expect to see here proper count of benchmarked. It works locally okay without -n auto! gonna try in the next commit

even output changes with and without -n!

with -n: 8 workers [192 items]
without: collected 259 items / 67 deselected / 192 selected

[MarshalX]

So here are the runs

without -n (2 min 24 sec):

  ============================= test session starts ==============================
  platform linux -- Python 3.14.0, pytest-8.4.1, pluggy-1.6.0
  codspeed: 4.2.0 (enabled, mode: instrumentation, callgraph: enabled)
  CodSpeed had to disable the following plugins: pytest-benchmark
  benchmark: 5.1.0 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
  rootdir: /home/runner/work/python-libipld/python-libipld
  configfile: pyproject.toml
  plugins: benchmark-5.1.0, xdist-3.8.0, codspeed-4.2.0
  collected 259 items / 67 deselected / 192 selected
  
  pytests/test_dag_cbor.py ............................................... [ 24%]
  ........................................................................ [ 61%]
  ........................................................................ [ 99%]
                                                                           [ 99%]
  pytests/test_decode_car.py .                                             [100%]
  =============================== 192 benchmarked ================================
  
  ================ 192 passed, 67 deselected in 117.46s (0:01:57) ================

with -n auto (2 min 10 sec):

  ============================= test session starts ==============================
  platform linux -- Python 3.14.0, pytest-8.4.1, pluggy-1.6.0
  codspeed: 4.2.0 (enabled, mode: instrumentation, callgraph: enabled)
  CodSpeed had to disable the following plugins: pytest-benchmark
  benchmark: 5.1.0 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
  rootdir: /home/runner/work/python-libipld/python-libipld
  configfile: pyproject.toml
  plugins: benchmark-5.1.0, xdist-3.8.0, codspeed-4.2.0
  created: 4/4 workers
  4 workers [192 items]
  
  ........................................................................ [ 37%]
  ........................................................................ [ 75%]
  ................................................                         [100%]================================ 0 benchmarked =================================
  
  ======================== 192 passed in 83.03s (0:01:23) ========================

[MarshalX]

At the moment, the macro runners are only available for organizations and not for personal accounts.

src: https://codspeed.io/docs/instruments/walltime#usage-on-personal-github-accounts

Okay then, back to simulation...