conbench-apache-arrow / Conbench performance report
succeeded
Mar 28, 2024 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 7 benchmarking runs that have been run so far on merge-commit b270dcd.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
ursa-i9-9960x
at 2024-03-28 03:30:34Z - Commit Run on
ec2-t3-xlarge-us-east-2
at 2024-03-28 01:17:18Z - Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-03-28 02:40:19Z - Commit Run on
arm64-t4g-linux-compute
at 2024-03-28 02:57:29Z - Commit Run on
test-mac-arm
at 2024-03-28 03:39:46Z - Commit Run on
arm64-m6g-linux-compute
at 2024-03-28 07:48:51Z - Commit Run on
ursa-thinkcentre-m75q
at 2024-03-28 12:03:09Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
test-mac-arm
at 2024-03-28 03:39:46Z -
Commit Run on
ursa-thinkcentre-m75q
at 2024-03-28 12:03:09ZFilterOverhead
(C++) with params=selectivity_benchmark/batch_size:1000/null_prob:100/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=simple_expression/batch_size:10000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:10000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=selectivity_benchmark/batch_size:1000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=ref_only_expression/batch_size:10000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:10000/null_prob:25/bool_true_prob:33/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:10000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:1000/null_prob:75/bool_true_prob:100/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=selectivity_benchmark/batch_size:1000/null_prob:75/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:1000/null_prob:25/bool_true_prob:33/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:10000/null_prob:25/bool_true_prob:33/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=selectivity_benchmark/batch_size:100000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:1000/null_prob:0/bool_true_prob:25/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:1000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkIntegerParsing
(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:1000/null_prob:25/bool_true_prob:33/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=simple_expression/batch_size:1000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=complex_expression/batch_size:10000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=selectivity_benchmark/batch_size:1000/null_prob:10/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:1000/null_prob:0/bool_true_prob:25/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverheadIsolated
(C++) with params=ref_only_expression/batch_size:100000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=complex_expression/batch_size:1000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:10000/null_prob:75/bool_true_prob:100/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=ref_only_expression/batch_size:1000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkConstructFromShortStdVector
(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkFilterOverhead
(C++) with params=selectivity_benchmark/batch_size:10000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:10000/null_prob:75/bool_true_prob:100/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:1000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:10000/null_prob:0/bool_true_prob:25/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:100000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead
(C++) with params=selectivity_benchmark/batch_size:100000/null_prob:10/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading