conbench-apache-arrow / Conbench performance report
failed
Aug 11, 2023 in 0s
Found 1 regression
After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit 59f30f0.
Benchmarks with performance regressions
There was 1 possible performance regression, according to the lookback z-score method.
Benchmarks with regressions:
- Commit Run on
ursa-i9-9960x
at 2023-08-11 19:41:31Z
All benchmark runs analyzed:
- Commit Run on
ursa-thinkcentre-m75q
at 2023-08-09 18:52:53Z - Commit Run on
ursa-i9-9960x
at 2023-08-11 19:41:31Z - Commit Run on
ec2-t3-xlarge-us-east-2
at 2023-08-08 18:26:34Z - Commit Run on
ec2-m5-4xlarge-us-east-2
at 2023-08-08 18:31:59Z - Commit Run on
arm64-t4g-linux-compute
at 2023-08-08 19:28:06Z - Commit Run on
arm64-m6g-linux-compute
at 2023-08-09 06:52:31Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
ursa-thinkcentre-m75q
at 2023-08-09 18:52:53ZArrayArrayKernel
(C++) with params=<Divide, DoubleType>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkLruCacheLookup
(C++) with params=8/1024, source=cpp-micro, suite=arrow-cache-benchmarkUniqueInt64
(C++) with params=6, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkUniqueInt64
(C++) with params=13, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkBenchmarkTemporalBinary
(C++) with params=<MonthDayNanoBetween, date64_type>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmark
-
Commit Run on
arm64-t4g-linux-compute
at 2023-08-08 19:28:06Z -
Commit Run on
arm64-m6g-linux-compute
at 2023-08-09 06:52:31Z
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.