Skip to content

[SPARK-43910][SQL] Strip __auto_generated_subquery_name from ids in errors#41411

Closed
MaxGekk wants to merge 2 commits intoapache:masterfrom
MaxGekk:strip__auto_generated_subquery_name
Closed

[SPARK-43910][SQL] Strip __auto_generated_subquery_name from ids in errors#41411
MaxGekk wants to merge 2 commits intoapache:masterfrom
MaxGekk:strip__auto_generated_subquery_name

Conversation

@MaxGekk
Copy link
Copy Markdown
Member

@MaxGekk MaxGekk commented May 31, 2023

What changes were proposed in this pull request?

In the PR, I propose the drop the prefix __auto_generated_subquery_name from SQL ids in errors.

Why are the changes needed?

The changes should improve user experience with Spark SQL by making error messages shorter and more clear.

Does this PR introduce any user-facing change?

Should not.

How was this patch tested?

By running the affected test suites:

$ PYSPARK_PYTHON=python3 build/sbt "sql/testOnly org.apache.spark.sql.SQLQueryTestSuite"
$ build/sbt "test:testOnly *QueryCompilationErrorsSuite"
$ build/sbt "sql/testOnly *QueryExecutionErrorsSuite"

@github-actions github-actions bot added the SQL label May 31, 2023
@MaxGekk MaxGekk changed the title [WIP][SQL][TESTS] Strip __auto_generated_subquery_name from ids in errors [SPARK-43910][SQL] Strip __auto_generated_subquery_name from ids in errors Jun 1, 2023
@MaxGekk MaxGekk marked this pull request as ready for review June 1, 2023 06:38
@MaxGekk
Copy link
Copy Markdown
Member Author

MaxGekk commented Jun 1, 2023

cc @bersprockets @cloud-fan

@MaxGekk
Copy link
Copy Markdown
Member Author

MaxGekk commented Jun 1, 2023

Merging to master. Thank you, @HyukjinKwon @cloud-fan for review.

@MaxGekk MaxGekk closed this in adabbb5 Jun 1, 2023
@bersprockets
Copy link
Copy Markdown
Contributor

Belated lgtm from me too. Thanks for this change.

czxm pushed a commit to czxm/spark that referenced this pull request Jun 12, 2023
… errors

### What changes were proposed in this pull request?
In the PR, I propose the drop the prefix `__auto_generated_subquery_name` from SQL ids in errors.

### Why are the changes needed?
The changes should improve user experience with Spark SQL by making error messages shorter and more clear.

### Does this PR introduce _any_ user-facing change?
Should not.

### How was this patch tested?
By running the affected test suites:
```
$ PYSPARK_PYTHON=python3 build/sbt "sql/testOnly org.apache.spark.sql.SQLQueryTestSuite"
$ build/sbt "test:testOnly *QueryCompilationErrorsSuite"
$ build/sbt "sql/testOnly *QueryExecutionErrorsSuite"
```

Closes apache#41411 from MaxGekk/strip__auto_generated_subquery_name.

Authored-by: Max Gekk <max.gekk@gmail.com>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants