After merging your PR, Conbench analyzed the 7 benchmarking runs that have been run so far on merge-commit 1c546fb.

Benchmarks with errors

These are errors that were caught while running the benchmarks. You can click each link to go to the Conbench entry for that benchmark, which might have more information about what the error was.

• Commit Run on ursa-i9-9960x at 2024-05-16 15:15:25Z
  • dataset-read (Python) with async=True, dataset=nyctaxi_multi_parquet_s3, pre_buffer=false
  • dataset-read (Python) with async=True, dataset=nyctaxi_multi_parquet_s3, pre_buffer=false

Benchmarks with performance regressions

There was 1 possible performance regression, according to the lookback z-score method.

Benchmarks with regressions:

• Commit Run on ursa-i9-9960x at 2024-05-16 15:15:25Z
  • dataset-read (Python) with async=True, dataset=nyctaxi_multi_parquet_s3, pre_buffer=false

All benchmark runs analyzed:

• Commit Run on test-mac-arm at 2024-05-16 15:13:58Z
• Commit Run on ec2-m5-4xlarge-us-east-2 at 2024-05-16 13:42:14Z
• Commit Run on ursa-thinkcentre-m75q at 2024-05-16 13:55:03Z
• Commit Run on arm64-t4g-linux-compute at 2024-05-16 15:00:37Z
• Commit Run on ursa-i9-9960x at 2024-05-16 15:15:25Z
• Commit Run on arm64-m6g-linux-compute at 2024-05-16 15:21:22Z
• Commit Run on ec2-t3-xlarge-us-east-2 at 2024-05-16 16:32:44Z

Unstable benchmarks with performance regressions

The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.

• Commit Run on test-mac-arm at 2024-05-16 15:13:58Z

  • SetBitRunReader (C++) with params=0, source=cpp-micro, suite=arrow-bit-util-benchmark

• Commit Run on ursa-thinkcentre-m75q at 2024-05-16 13:55:03Z

  • BinaryBitmapReaderSum (C++) with params=64, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BinaryBitmapReaderSum (C++) with params=4096, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BinaryBitmapReaderSum (C++) with params=65536, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BinaryBitmapReaderSumWithOffset (C++) with params=4096, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BinaryBitmapReaderSumWithOffset (C++) with params=512, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BinaryBitmapReaderSumWithOffset (C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BinaryBitmapReaderSumWithOffset (C++) with params=65536, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BinaryBitmapReaderSumWithOffset (C++) with params=64, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BinaryBitmapReaderSum (C++) with params=512, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BinaryBitmapReaderSum (C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmark

• Commit Run on arm64-t4g-linux-compute at 2024-05-16 15:00:37Z

  • ArrayRangeEqualsBoolean (C++) with params=65536/1, source=cpp-micro, suite=arrow-compare-benchmark
  • ArrayRangeEqualsInt32 (C++) with params=65536/1, source=cpp-micro, suite=arrow-compare-benchmark