conbench-apache-arrow / Conbench performance report
succeeded
May 24, 2024 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit 8a76082.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
arm64-t4g-linux-compute
at 2024-05-24 10:04:34Z - Commit Run on
ursa-thinkcentre-m75q
at 2024-05-24 07:50:13Z - Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-05-24 07:29:14Z - Commit Run on
arm64-m6g-linux-compute
at 2024-05-24 07:42:16Z - Commit Run on
test-mac-arm
at 2024-05-24 13:23:34Z - Commit Run on
ec2-t3-xlarge-us-east-2
at 2024-05-24 18:19:17Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
arm64-t4g-linux-compute
at 2024-05-24 10:04:34ZErrorSchemeBoolNoInline
(C++) with source=cpp-micro, suite=arrow-type-benchmarkTrieLookupFound
(C++) with source=cpp-micro, suite=arrow-trie-benchmarkConstructFromEmptyStdVector
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkSchemaEquals
(C++) with source=cpp-micro, suite=arrow-type-benchmarkErrorSchemeException
(C++) with source=cpp-micro, suite=arrow-type-benchmarkBM_PlainDecodingSpacedFloat
(C++) with params=32768/10000, source=cpp-micro, suite=parquet-encoding-benchmarkErrorSchemeNoError
(C++) with source=cpp-micro, suite=arrow-type-benchmarkInlinedTrieLookupFound
(C++) with source=cpp-micro, suite=arrow-trie-benchmarkConstructFromEmptyStdVector
(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkInlinedTrieLookupNotFound
(C++) with source=cpp-micro, suite=arrow-trie-benchmarkMaxElementWiseArrayScalarInt64
(C++) with params=65536/2, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkCopyEmptyVector
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkSchemaEqualsWithMetadata
(C++) with source=cpp-micro, suite=arrow-type-benchmarkTypeEqualsSimple
(C++) with source=cpp-micro, suite=arrow-type-benchmarkTrieLookupNotFound
(C++) with source=cpp-micro, suite=arrow-trie-benchmarkShortVectorPushBack
(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmark
-
Commit Run on
ursa-thinkcentre-m75q
at 2024-05-24 07:50:13ZBM_DictEncodingInt64_repeats
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaBitPackingEncode_Int64_Wide
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkCheckIndexBoundsInt32
(C++) with params=32768/1, source=cpp-micro, suite=arrow-int-util-benchmarkBM_DeltaBitPackingEncode_Int64_Narrow
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmark
-
Commit Run on
test-mac-arm
at 2024-05-24 13:23:34ZArrayArrayKernel
(C++) with params=<DivideChecked, UInt16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, Int8Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, Int16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkProjectionOverhead
(C++) with params=zero_copy_expression/batch_size:1000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, UInt16Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_PlainEncodingFloatNaN
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkArraySortIndicesStringWideDict
(C++) with params=1048576/100, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkProjectionOverhead
(C++) with params=complex_expression/batch_size:1000000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmarkArrayScalarKernel
(C++) with params=<AddChecked, Int16Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_WriteColumn
(C++) with params=<false,Int64Type>, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkArraySortIndicesStringWideDict
(C++) with params=65536/0, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel
(C++) with params=<DivideChecked, UInt32Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<DivideChecked, Int8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkProjectionOverhead
(C++) with params=ref_only_expression/batch_size:10000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmarkArrayArrayKernel
(C++) with params=<DivideChecked, UInt16Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, Int16Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<MultiplyChecked, Int32Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<DivideChecked, UInt8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<DivideChecked, UInt64Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkProjectionOverhead
(C++) with params=simple_expression/batch_size:100000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, UInt16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<AddChecked, Int16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkProjectionOverhead
(C++) with params=simple_expression/batch_size:1000000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmarkArrayArrayKernel
(C++) with params=<DivideChecked, UInt64Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkThreadPoolSubmit
(C++) with params=threads:8/task_cost:1000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, UInt64Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkProjectionOverhead
(C++) with params=zero_copy_expression/batch_size:1000000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmarkProjectionOverhead
(C++) with params=zero_copy_expression/batch_size:100000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, UInt32Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<DivideChecked, UInt32Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmark
-
Commit Run on
ec2-t3-xlarge-us-east-2
at 2024-05-24 18:19:17Z
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading