Skip to content

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Sep 17, 2025

Which issue does this PR close?

Rationale for this change

Let's keep the dependencies up to date

What changes are included in this PR?

  1. Update dependencies
  2. Update for API changes

Are these changes tested?

Are there any user-facing changes?

@github-actions github-actions bot added documentation Improvements or additions to documentation core Core DataFusion crate sqllogictest SQL Logic Tests (.slt) common Related to common crate proto Related to proto crate datasource Changes to the datasource crate physical-plan Changes to the physical-plan crate labels Sep 17, 2025
@alamb alamb marked this pull request as draft September 17, 2025 18:14
@alamb
Copy link
Contributor Author

alamb commented Sep 17, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (eb06574) to e711f14 diff using: clickbench_pushdown
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 17, 2025

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow-56.2
--------------------
Benchmark clickbench_pushdown.json
--------------------
┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query        ┃        HEAD ┃ alamb_update_arrow-56 ┃        Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0     │     2.14 ms │               2.30 ms │  1.08x slower │
│ QQuery 1     │    54.86 ms │              55.03 ms │     no change │
│ QQuery 2     │   133.28 ms │             138.67 ms │     no change │
│ QQuery 3     │   166.82 ms │             166.92 ms │     no change │
│ QQuery 4     │  1088.64 ms │            1069.12 ms │     no change │
│ QQuery 5     │  1516.49 ms │            1533.94 ms │     no change │
│ QQuery 6     │     2.18 ms │               2.21 ms │     no change │
│ QQuery 7     │    77.40 ms │              73.26 ms │ +1.06x faster │
│ QQuery 8     │  1477.92 ms │            1481.65 ms │     no change │
│ QQuery 9     │  1889.00 ms │            1853.32 ms │     no change │
│ QQuery 10    │   437.02 ms │             500.67 ms │  1.15x slower │
│ QQuery 11    │   521.25 ms │             567.56 ms │  1.09x slower │
│ QQuery 12    │  1825.95 ms │            1575.50 ms │ +1.16x faster │
│ QQuery 13    │  2791.02 ms │            2545.02 ms │ +1.10x faster │
│ QQuery 14    │  1934.92 ms │            1628.84 ms │ +1.19x faster │
│ QQuery 15    │  1221.30 ms │            1197.34 ms │     no change │
│ QQuery 16    │  2690.82 ms │            2693.55 ms │     no change │
│ QQuery 17    │  2673.35 ms │            2648.19 ms │     no change │
│ QQuery 18    │  5265.38 ms │            4981.51 ms │ +1.06x faster │
│ QQuery 19    │   130.17 ms │             146.72 ms │  1.13x slower │
│ QQuery 20    │  2044.92 ms │            2024.34 ms │     no change │
│ QQuery 21    │  2403.20 ms │            2403.81 ms │     no change │
│ QQuery 22    │  4890.85 ms │            4084.19 ms │ +1.20x faster │
│ QQuery 23    │  1405.35 ms │            1153.59 ms │ +1.22x faster │
│ QQuery 24    │   283.85 ms │             255.15 ms │ +1.11x faster │
│ QQuery 25    │   957.34 ms │             668.76 ms │ +1.43x faster │
│ QQuery 26    │   487.20 ms │             348.33 ms │ +1.40x faster │
│ QQuery 27    │  4066.89 ms │            2995.09 ms │ +1.36x faster │
│ QQuery 28    │ 26774.71 ms │           24349.77 ms │ +1.10x faster │
│ QQuery 29    │   995.51 ms │             968.00 ms │     no change │
│ QQuery 30    │  2168.55 ms │            2153.60 ms │     no change │
│ QQuery 31    │  2137.10 ms │            2093.92 ms │     no change │
│ QQuery 32    │  4624.31 ms │            4442.14 ms │     no change │
│ QQuery 33    │  5779.88 ms │            5636.47 ms │     no change │
│ QQuery 34    │  6013.97 ms │            5922.57 ms │     no change │
│ QQuery 35    │  2082.39 ms │            2060.44 ms │     no change │
│ QQuery 36    │    27.43 ms │              26.56 ms │     no change │
│ QQuery 37    │    25.96 ms │              26.41 ms │     no change │
│ QQuery 38    │    26.29 ms │              25.94 ms │     no change │
│ QQuery 39    │    26.15 ms │              25.81 ms │     no change │
│ QQuery 40    │    27.00 ms │              27.30 ms │     no change │
│ QQuery 41    │    26.52 ms │              25.10 ms │ +1.06x faster │
│ QQuery 42    │    27.41 ms │              25.17 ms │ +1.09x faster │
└──────────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 93202.68ms │
│ Total Time (alamb_update_arrow-56)   │ 86603.76ms │
│ Average Time (HEAD)                  │  2167.50ms │
│ Average Time (alamb_update_arrow-56) │  2014.04ms │
│ Queries Faster                       │         14 │
│ Queries Slower                       │          4 │
│ Queries with No Change               │         25 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

@alamb
Copy link
Contributor Author

alamb commented Sep 17, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (eb06574) to e711f14 diff using: tpch_topk
Results will be posted here when complete

@alamb

This comment was marked as outdated.

@alamb

This comment was marked as outdated.

@alamb alamb force-pushed the alamb/update_arrow-56.2 branch from eb06574 to 3c530bf Compare September 19, 2025 15:15
@github-actions github-actions bot removed documentation Improvements or additions to documentation core Core DataFusion crate sqllogictest SQL Logic Tests (.slt) common Related to common crate proto Related to proto crate datasource Changes to the datasource crate physical-plan Changes to the physical-plan crate labels Sep 19, 2025
@alamb

This comment was marked as outdated.

@alamb

This comment was marked as outdated.

@alamb

This comment was marked as outdated.

@alamb

This comment was marked as outdated.

@alamb

This comment was marked as outdated.

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: clickbench_pushdown
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: tpch_topk
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: clickbench_partitioned
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: clickbench_extended
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: tpch_mem
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: clickbench_pushdown
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: tpch_topk
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: clickbench_partitioned
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: clickbench_extended
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 23, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1014-gcp #15~24.04.1-Ubuntu SMP Fri Jul 25 23:26:08 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: tpch_mem
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1016-gcp #17~24.04.1-Ubuntu SMP Wed Sep 3 01:55:36 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: clickbench_pushdown
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow-56.2
--------------------
Benchmark clickbench_pushdown.json
--------------------
┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query        ┃        HEAD ┃ alamb_update_arrow-56 ┃        Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0     │     2.25 ms │               2.19 ms │     no change │
│ QQuery 1     │    52.59 ms │              54.01 ms │     no change │
│ QQuery 2     │   135.55 ms │             139.09 ms │     no change │
│ QQuery 3     │   159.42 ms │             159.30 ms │     no change │
│ QQuery 4     │  1037.73 ms │            1138.78 ms │  1.10x slower │
│ QQuery 5     │  1486.56 ms │            1501.27 ms │     no change │
│ QQuery 6     │     2.18 ms │               2.17 ms │     no change │
│ QQuery 7     │    70.43 ms │              71.36 ms │     no change │
│ QQuery 8     │  1415.70 ms │            1460.94 ms │     no change │
│ QQuery 9     │  1779.92 ms │            1757.59 ms │     no change │
│ QQuery 10    │   477.23 ms │             507.12 ms │  1.06x slower │
│ QQuery 11    │   554.63 ms │             577.03 ms │     no change │
│ QQuery 12    │  1510.02 ms │            1639.25 ms │  1.09x slower │
│ QQuery 13    │  2476.48 ms │            2508.93 ms │     no change │
│ QQuery 14    │  1633.87 ms │            1681.69 ms │     no change │
│ QQuery 15    │  1167.20 ms │            1250.75 ms │  1.07x slower │
│ QQuery 16    │  2639.59 ms │            2722.11 ms │     no change │
│ QQuery 17    │  2597.25 ms │            2687.88 ms │     no change │
│ QQuery 18    │  5065.73 ms │            4921.21 ms │     no change │
│ QQuery 19    │   145.35 ms │             143.30 ms │     no change │
│ QQuery 20    │  1979.92 ms │            1977.45 ms │     no change │
│ QQuery 21    │  2381.91 ms │            2442.83 ms │     no change │
│ QQuery 22    │  4179.75 ms │            4251.33 ms │     no change │
│ QQuery 23    │  1161.04 ms │            1144.23 ms │     no change │
│ QQuery 24    │   259.68 ms │             248.55 ms │     no change │
│ QQuery 25    │   658.80 ms │             690.96 ms │     no change │
│ QQuery 26    │   342.08 ms │             372.05 ms │  1.09x slower │
│ QQuery 27    │  3078.24 ms │            3079.65 ms │     no change │
│ QQuery 28    │ 24275.27 ms │           25971.82 ms │  1.07x slower │
│ QQuery 29    │   986.60 ms │             980.69 ms │     no change │
│ QQuery 30    │  2078.77 ms │            2155.10 ms │     no change │
│ QQuery 31    │  2052.39 ms │            2120.62 ms │     no change │
│ QQuery 32    │  4601.27 ms │            4806.13 ms │     no change │
│ QQuery 33    │  5678.67 ms │            5741.13 ms │     no change │
│ QQuery 34    │  5885.47 ms │            6230.49 ms │  1.06x slower │
│ QQuery 35    │  1983.77 ms │            2008.76 ms │     no change │
│ QQuery 36    │    25.81 ms │              25.47 ms │     no change │
│ QQuery 37    │    25.45 ms │              25.44 ms │     no change │
│ QQuery 38    │    25.01 ms │              25.20 ms │     no change │
│ QQuery 39    │    25.60 ms │              24.70 ms │     no change │
│ QQuery 40    │    26.82 ms │              24.97 ms │ +1.07x faster │
│ QQuery 41    │    25.21 ms │              24.83 ms │     no change │
│ QQuery 42    │    24.67 ms │              24.74 ms │     no change │
└──────────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 86171.86ms │
│ Total Time (alamb_update_arrow-56)   │ 89323.14ms │
│ Average Time (HEAD)                  │  2004.00ms │
│ Average Time (alamb_update_arrow-56) │  2077.28ms │
│ Queries Faster                       │          1 │
│ Queries Slower                       │          7 │
│ Queries with No Change               │         35 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1016-gcp #17~24.04.1-Ubuntu SMP Wed Sep 3 01:55:36 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: tpch_topk
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1016-gcp #17~24.04.1-Ubuntu SMP Wed Sep 3 01:55:36 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: clickbench_partitioned
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow-56.2
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query        ┃        HEAD ┃ alamb_update_arrow-56 ┃        Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0     │     2.23 ms │               2.21 ms │     no change │
│ QQuery 1     │    49.75 ms │              49.90 ms │     no change │
│ QQuery 2     │   133.28 ms │             136.71 ms │     no change │
│ QQuery 3     │   164.17 ms │             158.70 ms │     no change │
│ QQuery 4     │  1067.35 ms │            1072.90 ms │     no change │
│ QQuery 5     │  1497.99 ms │            1541.38 ms │     no change │
│ QQuery 6     │     2.33 ms │               2.16 ms │ +1.08x faster │
│ QQuery 7     │    53.41 ms │              54.64 ms │     no change │
│ QQuery 8     │  1437.09 ms │            1440.15 ms │     no change │
│ QQuery 9     │  1819.04 ms │            1804.26 ms │     no change │
│ QQuery 10    │   378.93 ms │             388.87 ms │     no change │
│ QQuery 11    │   432.49 ms │             448.75 ms │     no change │
│ QQuery 12    │  1356.10 ms │            1379.81 ms │     no change │
│ QQuery 13    │  2131.44 ms │            2090.93 ms │     no change │
│ QQuery 14    │  1274.89 ms │            1272.06 ms │     no change │
│ QQuery 15    │  1246.19 ms │            1225.55 ms │     no change │
│ QQuery 16    │  2645.79 ms │            2645.47 ms │     no change │
│ QQuery 17    │  2633.58 ms │            2662.60 ms │     no change │
│ QQuery 18    │  4909.04 ms │            5071.93 ms │     no change │
│ QQuery 19    │   128.41 ms │             128.30 ms │     no change │
│ QQuery 20    │  1994.34 ms │            2013.33 ms │     no change │
│ QQuery 21    │  2290.86 ms │            2296.62 ms │     no change │
│ QQuery 22    │  3894.44 ms │            3948.91 ms │     no change │
│ QQuery 23    │ 12538.53 ms │           12723.10 ms │     no change │
│ QQuery 24    │   211.88 ms │             211.74 ms │     no change │
│ QQuery 25    │   499.66 ms │             503.52 ms │     no change │
│ QQuery 26    │   210.67 ms │             236.42 ms │  1.12x slower │
│ QQuery 27    │  2793.07 ms │            2867.37 ms │     no change │
│ QQuery 28    │ 22816.81 ms │           24545.10 ms │  1.08x slower │
│ QQuery 29    │   986.89 ms │             983.22 ms │     no change │
│ QQuery 30    │  1316.54 ms │            1311.52 ms │     no change │
│ QQuery 31    │  1312.21 ms │            1325.72 ms │     no change │
│ QQuery 32    │  4471.70 ms │            4671.70 ms │     no change │
│ QQuery 33    │  5672.69 ms │            5702.00 ms │     no change │
│ QQuery 34    │  5852.44 ms │            6331.44 ms │  1.08x slower │
│ QQuery 35    │  1981.13 ms │            1982.79 ms │     no change │
│ QQuery 36    │   119.28 ms │             123.01 ms │     no change │
│ QQuery 37    │    51.40 ms │              54.30 ms │  1.06x slower │
│ QQuery 38    │   120.60 ms │             122.03 ms │     no change │
│ QQuery 39    │   195.36 ms │             199.16 ms │     no change │
│ QQuery 40    │    43.67 ms │              43.63 ms │     no change │
│ QQuery 41    │    38.92 ms │              38.80 ms │     no change │
│ QQuery 42    │    31.15 ms │              33.92 ms │  1.09x slower │
└──────────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 92807.74ms │
│ Total Time (alamb_update_arrow-56)   │ 95846.61ms │
│ Average Time (HEAD)                  │  2158.32ms │
│ Average Time (alamb_update_arrow-56) │  2228.99ms │
│ Queries Faster                       │          1 │
│ Queries Slower                       │          5 │
│ Queries with No Change               │         37 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1016-gcp #17~24.04.1-Ubuntu SMP Wed Sep 3 01:55:36 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: clickbench_extended
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow-56.2
--------------------
Benchmark clickbench_extended.json
--------------------
┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query        ┃        HEAD ┃ alamb_update_arrow-56 ┃        Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0     │  2715.61 ms │            2644.91 ms │     no change │
│ QQuery 1     │  1310.56 ms │            1215.79 ms │ +1.08x faster │
│ QQuery 2     │  2560.32 ms │            2384.65 ms │ +1.07x faster │
│ QQuery 3     │  1158.12 ms │            1161.57 ms │     no change │
│ QQuery 4     │  2244.20 ms │            2246.62 ms │     no change │
│ QQuery 5     │ 27549.50 ms │           27558.29 ms │     no change │
│ QQuery 6     │  4230.84 ms │            4204.29 ms │     no change │
│ QQuery 7     │  3581.63 ms │            3511.52 ms │     no change │
└──────────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 45350.77ms │
│ Total Time (alamb_update_arrow-56)   │ 44927.64ms │
│ Average Time (HEAD)                  │  5668.85ms │
│ Average Time (alamb_update_arrow-56) │  5615.96ms │
│ Queries Faster                       │          2 │
│ Queries Slower                       │          0 │
│ Queries with No Change               │          6 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

🤖 ./gh_compare_branch.sh Benchmark Script Running
Linux aal-dev 6.14.0-1016-gcp #17~24.04.1-Ubuntu SMP Wed Sep 3 01:55:36 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow-56.2 (81b4a56) to 432995c diff using: tpch_mem
Results will be posted here when complete

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow-56.2
--------------------
Benchmark tpch_mem_sf1.json
--------------------
┏━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query        ┃      HEAD ┃ alamb_update_arrow-56 ┃       Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 1     │ 181.83 ms │             174.63 ms │    no change │
│ QQuery 2     │  26.84 ms │              28.24 ms │ 1.05x slower │
│ QQuery 3     │  46.62 ms │              47.83 ms │    no change │
│ QQuery 4     │  28.45 ms │              27.58 ms │    no change │
│ QQuery 5     │  74.82 ms │              76.28 ms │    no change │
│ QQuery 6     │  19.43 ms │              19.58 ms │    no change │
│ QQuery 7     │ 153.39 ms │             155.28 ms │    no change │
│ QQuery 8     │  33.12 ms │              32.29 ms │    no change │
│ QQuery 9     │  87.52 ms │              87.31 ms │    no change │
│ QQuery 10    │  58.84 ms │              61.00 ms │    no change │
│ QQuery 11    │  42.25 ms │              42.27 ms │    no change │
│ QQuery 12    │  52.29 ms │              52.39 ms │    no change │
│ QQuery 13    │  46.66 ms │              47.94 ms │    no change │
│ QQuery 14    │  13.79 ms │              13.65 ms │    no change │
│ QQuery 15    │  24.51 ms │              25.06 ms │    no change │
│ QQuery 16    │  24.62 ms │              25.30 ms │    no change │
│ QQuery 17    │ 147.34 ms │             146.78 ms │    no change │
│ QQuery 18    │ 334.14 ms │             329.23 ms │    no change │
│ QQuery 19    │  35.79 ms │              38.88 ms │ 1.09x slower │
│ QQuery 20    │  49.53 ms │              50.69 ms │    no change │
│ QQuery 21    │ 232.03 ms │             230.33 ms │    no change │
│ QQuery 22    │  20.53 ms │              20.02 ms │    no change │
└──────────────┴───────────┴───────────────────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 1734.35ms │
│ Total Time (alamb_update_arrow-56)   │ 1732.55ms │
│ Average Time (HEAD)                  │   78.83ms │
│ Average Time (alamb_update_arrow-56) │   78.75ms │
│ Queries Faster                       │         0 │
│ Queries Slower                       │         2 │
│ Queries with No Change               │        20 │
│ Queries with Failure                 │         0 │
└──────────────────────────────────────┴───────────┘

@comphead
Copy link
Contributor

That was a smooth upgrade

Copy link
Contributor

@comphead comphead left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @alamb for running so many preps

@alamb
Copy link
Contributor Author

alamb commented Sep 24, 2025

Thanks @alamb for running so many preps

Thanks! I am just trying to keep the code flowing

@alamb alamb added this pull request to the merge queue Sep 24, 2025
Merged via the queue into apache:main with commit 5bbdb7e Sep 24, 2025
31 checks passed
@alamb alamb deleted the alamb/update_arrow-56.2 branch September 24, 2025 18:46
@findepi
Copy link
Member

findepi commented Sep 25, 2025

Technically speaking, this fixed:

however, let's get a regression test in too

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants