[fix](variant) fix array subscript on pruned variant subpath#63891
Open
eldenmoon wants to merge 1 commit into
Open
[fix](variant) fix array subscript on pruned variant subpath#63891eldenmoon wants to merge 1 commit into
eldenmoon wants to merge 1 commit into
Conversation
Contributor
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
Member
Author
|
run buildall |
Contributor
There was a problem hiding this comment.
Pull request overview
This PR fixes a planner bug in variant subpath pruning where array subscripts / element_at could remain attached to the original (unpruned) variant access chain after pruning, causing valid 1-based indexing to incorrectly return NULL. It updates the Nereids pruning rewrite to ensure outer array access uses the pruned subpath slot, and adds both FE unit coverage and regression coverage (nested-group and non-nested-group).
Changes:
- Fix
VariantSubPathPruningproject rewrite to replace nestedelement_atchains inside a top-levelElementAtprojection using the pruned-slot map. - Add FE planner unit test asserting the pruned subpath is used for array subscript projections.
- Add two regression tests covering both nested-group and plain
VARIANTarray-leaf cases for CIR-20316.
Reviewed changes
Copilot reviewed 4 out of 4 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/VariantSubPathPruning.java |
Ensures LogicalProject rewrites replace nested variant element_at chains inside top-level ElementAt projections so subscripts apply to the pruned subpath slot. |
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/VariantPruningLogicTest.java |
Adds a unit test to validate explain/slot-subpath behavior for cast(v['items']['type'] as array<string>)[1]. |
regression-test/suites/variant_p0/test_variant_array_subscript_cir_20316.groovy |
Adds non-nested-group regression verifying 1-based array subscripts and element_at return correct non-NULL results after pruning. |
regression-test/suites/variant_p0/nested_group/test_variant_nested_array_subscript_cir_20316.groovy |
Adds nested-group regression covering array-of-objects behavior for the same pruning/subscript scenario. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Comment on lines
+79
to
+84
| Assertions.assertTrue(explain.contains("final projections: element_at(CAST(v AS array<text>), 1)"), | ||
| explain); | ||
| Assertions.assertTrue(explain.contains("subColPath=[items, type]"), | ||
| explain); | ||
| Assertions.assertFalse(explain.contains("element_at(CAST(element_at(element_at("), | ||
| explain); |
eldenmoon
force-pushed
the
branch-cir-20316-variant-array-subscript
branch
from
223b553 to
473f703
Compare
Contributor
|
/review |
Member
Author
|
run buildall |
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
Review result: one regression-test standards issue needs to be fixed before approval.
Critical checkpoint conclusions:
- Goal/test: the code change appears to address array subscript on a pruned variant subpath, and the added tests cover the target shape. The regression test format needs correction.
- Scope: the production code change is small and focused.
- Concurrency/lifecycle/config/compatibility/persistence: not materially involved by this PR.
- Parallel paths: project expression replacement paths were checked; no additional production-path issue found.
- Test coverage/results: coverage was added, but the new deterministic regression result is inline instead of generated via the standard qt/.out mechanism.
- Observability/performance: no new observability need or obvious performance issue found.
User focus: no additional user-provided review focus was specified.
eldenmoon
force-pushed
the
branch-cir-20316-variant-array-subscript
branch
from
473f703 to
aee1c89
Compare
Member
Author
|
run buildall |
1 similar comment
Member
Author
|
run buildall |
morrySnow
reviewed
May 29, 2026
| sql "sync" | ||
|
|
||
| order_qt_array_subscript """ | ||
| SELECT id, |
Contributor
There was a problem hiding this comment.
this case's result is correct on current master, so should update this case
Contributor
TPC-H: Total hot run time: 31309 ms |
Contributor
TPC-DS: Total hot run time: 171951 ms |
Contributor
FE UT Coverage ReportIncrement line coverage |
Contributor
FE UT Coverage ReportIncrement line coverage |
Contributor
FE Regression Coverage ReportIncrement line coverage |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What problem does this PR solve?
Fix variant subpath pruning for projections where the top-level expression is an array subscript or
element_atover a variant subpath. The planner could leave the outer subscript on the original variant access chain after pruning, which made valid 1-based array subscripts returnNULL.original array-of-objects repro depends on nested-group variant semantics, so the regression in this PR uses a plain
VARIANTarray leaf to cover the same planner bug without relying on nested group.Check List
Tests
./run-fe-ut.sh --run org.apache.doris.nereids.rules.rewrite.VariantPruningLogicTest./run-regression-test.sh --run --conf tmp/regression-conf.auto.groovy -d variant_p0 -s test_variant_array_subscript -forceGenOut./run-regression-test.sh --run --conf tmp/regression-conf.auto.groovy -d variant_p0 -s test_variant_array_subscript