Skip to content

[GLUTEN-8821][VL] Update aggregate/generator/window support doc and script#8971

Merged
marin-ma merged 5 commits intoapache:mainfrom
marin-ma:update-agg-generator-support
Apr 4, 2025
Merged

[GLUTEN-8821][VL] Update aggregate/generator/window support doc and script#8971
marin-ma merged 5 commits intoapache:mainfrom
marin-ma:update-agg-generator-support

Conversation

@marin-ma
Copy link
Contributor

No description provided.

@github-actions github-actions bot added CORE works for Gluten Core TOOLS DOCS labels Mar 11, 2025
@github-actions
Copy link

#8821

@github-actions
Copy link

Run Gluten Clickhouse CI on x86

1 similar comment
@github-actions
Copy link

Run Gluten Clickhouse CI on x86

## Aggregate Functions

| Spark Functions | Spark Expressions | Status | Restrictions |
|-----------------------|------------------------------------|----------|----------------|
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it looks like the ANSI flag and the detail datatype support are missed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can't generate the datatype support list from parsing the log from unit tests, as they don't cover all function signatures. We can improve this by running expression fuzzer test in Gluten.

@marin-ma marin-ma force-pushed the update-agg-generator-support branch from 8424096 to ae8c0ab Compare March 31, 2025 08:20
@github-actions
Copy link

Run Gluten Clickhouse CI on x86

@marin-ma marin-ma force-pushed the update-agg-generator-support branch from ae8c0ab to e93b93d Compare March 31, 2025 10:41
@github-actions
Copy link

Run Gluten Clickhouse CI on x86

1 similar comment
@github-actions
Copy link

Run Gluten Clickhouse CI on x86

Copy link
Member

@zhouyuan zhouyuan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@zhouyuan
Copy link
Member

zhouyuan commented Apr 3, 2025

@marin-ma there is one small conflict on gluten version, would you please do a rebase?

@marin-ma marin-ma force-pushed the update-agg-generator-support branch from 055e046 to 547aa21 Compare April 3, 2025 13:04
@github-actions
Copy link

github-actions bot commented Apr 3, 2025

Run Gluten Clickhouse CI on x86

@marin-ma marin-ma merged commit 637bc99 into apache:main Apr 4, 2025
50 checks passed
@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCDS SF2000 with Velox backend, for reference only ====

query log/native_master_04_04_2025_time.csv log/native_master_04_03_2025_0bc5e2f13d_time.csv difference percentage
q1 11.66 11.02 -0.644 94.47%
q2 10.87 11.38 0.503 104.63%
q3 3.02 2.47 -0.558 81.54%
q4 50.86 51.32 0.461 100.91%
q5 8.57 8.54 -0.028 99.68%
q6 4.26 4.85 0.592 113.90%
q7 5.10 3.12 -1.987 61.08%
q8 3.64 4.50 0.858 123.59%
q9 14.75 16.33 1.580 110.71%
q10 12.63 13.75 1.121 108.88%
q11 29.37 26.61 -2.763 90.59%
q12 2.07 2.92 0.843 140.64%
q13 5.16 6.87 1.715 133.25%
q14a 44.58 43.07 -1.508 96.62%
q14b 38.81 39.67 0.860 102.22%
q15 3.21 3.67 0.459 114.31%
q16 6.89 4.26 -2.627 61.88%
q17 5.22 6.30 1.082 120.72%
q18 7.49 7.63 0.143 101.91%
q19 2.73 5.80 3.063 212.08%
q20 1.80 2.61 0.809 144.94%
q21 1.64 0.84 -0.800 51.23%
q22 2.93 4.30 1.371 146.87%
q23a 61.59 62.45 0.858 101.39%
q23b 73.34 72.29 -1.048 98.57%
q24a 71.08 69.78 -1.297 98.17%
q24b 66.57 70.03 3.455 105.19%
q25 6.72 7.12 0.401 105.98%
q26 2.63 2.89 0.259 109.85%
q27 3.45 2.77 -0.674 80.44%
q28 17.61 17.30 -0.316 98.21%
q29 7.65 8.37 0.725 109.48%
q30 4.96 5.04 0.079 101.60%
q31 8.25 8.30 0.051 100.62%
q32 1.78 1.79 0.013 100.71%
q33 3.41 4.35 0.940 127.60%
q34 3.62 5.31 1.688 146.60%
q35 6.58 7.53 0.956 114.53%
q36 2.99 2.83 -0.163 94.57%
q37 4.15 3.35 -0.807 80.57%
q38 11.63 12.21 0.580 104.99%
q39a 4.12 4.93 0.809 119.64%
q39b 3.69 3.63 -0.060 98.37%
q40 3.94 3.90 -0.039 99.00%
q41 0.64 0.89 0.250 139.39%
q42 0.77 1.64 0.872 213.15%
q43 1.77 2.21 0.439 124.76%
q44 6.09 6.02 -0.076 98.75%
q45 3.14 3.61 0.474 115.10%
q46 4.40 4.02 -0.386 91.23%
q47 9.39 9.65 0.260 102.76%
q48 4.07 3.70 -0.364 91.05%
q49 5.28 5.53 0.245 104.63%
q50 17.92 17.43 -0.492 97.26%
q51 7.85 7.70 -0.145 98.15%
q52 1.01 0.95 -0.061 93.95%
q53 1.80 1.56 -0.233 87.05%
q54 5.34 6.03 0.692 112.97%
q55 0.63 1.29 0.662 205.16%
q56 4.98 3.50 -1.488 70.14%
q57 6.12 7.89 1.771 128.93%
q58 2.67 3.66 0.993 137.20%
q59 4.53 4.60 0.070 101.54%
q60 4.54 4.60 0.063 101.38%
q61 4.69 4.30 -0.390 91.68%
q62 2.69 2.78 0.089 103.31%
q63 1.60 1.54 -0.062 96.15%
q64 34.75 35.85 1.108 103.19%
q65 11.04 11.46 0.413 103.74%
q66 3.21 3.64 0.432 113.48%
q67 56.76 58.18 1.419 102.50%
q68 3.10 2.82 -0.276 91.10%
q69 4.83 5.58 0.746 115.44%
q70 6.03 5.37 -0.660 89.06%
q71 4.92 4.69 -0.227 95.38%
q72 20.79 23.38 2.587 112.44%
q73 2.41 2.70 0.296 112.31%
q74 17.63 17.46 -0.179 98.98%
q75 22.69 22.98 0.286 101.26%
q76 6.89 7.13 0.238 103.46%
q77 2.50 2.85 0.351 114.04%
q78 32.51 33.51 1.008 103.10%
q79 3.30 4.18 0.884 126.82%
q80 11.02 11.33 0.302 102.74%
q81 7.06 6.99 -0.075 98.93%
q82 5.35 6.39 1.042 119.47%
q83 1.57 1.89 0.316 120.13%
q84 2.61 2.76 0.147 105.62%
q85 5.79 5.53 -0.263 95.46%
q86 2.09 1.99 -0.107 94.89%
q87 11.91 12.24 0.326 102.74%
q88 15.62 15.05 -0.572 96.34%
q89 2.57 3.51 0.942 136.65%
q90 1.95 1.93 -0.023 98.83%
q91 3.94 4.35 0.413 110.50%
q92 1.40 2.26 0.863 161.55%
q93 23.69 23.16 -0.526 97.78%
q94 9.13 9.70 0.564 106.17%
q9 54.28 57.41 3.131 105.77%
q5 2.07 2.64 0.570 127.50%
q96 10.93 11.12 0.195 101.78%
q97 2.54 4.55 2.015 179.31%
q98 5.18 5.71 0.534 110.32%
q99 0.49 0.52 0.031 106.34%
total 1163.49 1195.88 32.387 102.78%

@GlutenPerfBot
Copy link
Contributor

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query log/native_master_04_04_2025_time.csv log/native_master_04_03_2025_0bc5e2f13d_time.csv difference percentage
q1 25.04 25.61 0.562 102.25%
q2 27.37 25.60 -1.770 93.53%
q3 33.05 33.25 0.201 100.61%
q4 25.82 28.60 2.779 110.76%
q5 60.28 60.48 0.201 100.33%
q6 9.58 8.26 -1.318 86.24%
q7 39.37 39.74 0.377 100.96%
q8 60.47 64.75 4.278 107.08%
q9 95.65 90.36 -5.287 94.47%
q10 43.74 37.91 -5.829 86.68%
q11 16.15 15.93 -0.218 98.65%
q12 17.60 17.24 -0.363 97.94%
q13 24.58 24.60 0.019 100.08%
q14 12.09 10.89 -1.198 90.10%
q15 25.32 25.67 0.355 101.40%
q16 12.34 12.17 -0.167 98.65%
q17 73.53 73.14 -0.392 99.47%
q18 112.41 111.25 -1.159 98.97%
q19 14.07 15.73 1.658 111.78%
q20 25.11 27.01 1.901 107.57%
q21 170.73 172.88 2.152 101.26%
q22 10.28 14.00 3.720 136.19%
total 934.59 935.09 0.503 100.05%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core DOCS TOOLS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants