Skip to content

[SPARK-37851][SQL][TESTS] Mark org.apache.spark.sql.hive.execution as slow tests#35151

Closed
HyukjinKwon wants to merge 2 commits intoapache:masterfrom
HyukjinKwon:SPARK-37851
Closed

[SPARK-37851][SQL][TESTS] Mark org.apache.spark.sql.hive.execution as slow tests#35151
HyukjinKwon wants to merge 2 commits intoapache:masterfrom
HyukjinKwon:SPARK-37851

Conversation

@HyukjinKwon
Copy link
Copy Markdown
Member

@HyukjinKwon HyukjinKwon commented Jan 10, 2022

What changes were proposed in this pull request?

This PR proposes to mark org.apache.spark.sql.hive.execution as slow tests to rebalance the jobs in GitHub Actions.

Why are the changes needed?

Related to SPARK-33171 and SPARK-32884. We should rebalance both:

Does this PR introduce any user-facing change?

No, dev-only.

How was this patch tested?

CI in this PR should test it out.

@github-actions github-actions bot added the SQL label Jan 10, 2022
@HyukjinKwon HyukjinKwon changed the title [SPARK-37851][SQL][TESTS] Mark TPCDS*Suite and SQLQuerySuite as ExtendedSQLTest [SPARK-37851][SQL][TESTS] Mark TPCDS*Suite and SQLQuerySuite as slow tests Jan 10, 2022
@HyukjinKwon HyukjinKwon changed the title [SPARK-37851][SQL][TESTS] Mark TPCDS*Suite and SQLQuerySuite as slow tests [SPARK-37851][SQL][TESTS] Mark TPCDS*Suite, SQLQuerySuite and org.apache.spark.sql.hive.execution as slow tests Jan 10, 2022
@HyukjinKwon
Copy link
Copy Markdown
Member Author

HyukjinKwon commented Jan 10, 2022

FYI: we should wait and see the actual elapsed time before merging it in.

@HyukjinKwon
Copy link
Copy Markdown
Member Author

SQL side the impact seems trivial. I will just target org.apache.spark.sql.hive.execution alone here.

@HyukjinKwon HyukjinKwon changed the title [SPARK-37851][SQL][TESTS] Mark TPCDS*Suite, SQLQuerySuite and org.apache.spark.sql.hive.execution as slow tests [SPARK-37851][SQL][TESTS] Mark org.apache.spark.sql.hive.execution as slow tests Jan 10, 2022
@HyukjinKwon
Copy link
Copy Markdown
Member Author

im reruning few times in https://github.com/HyukjinKwon/spark/runs/4759458274?check_suite_focus=true to verify the rebalancing.

Copy link
Copy Markdown
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you for this rebalancing, @HyukjinKwon and all.
Merged to master.

@HyukjinKwon
Copy link
Copy Markdown
Member Author

Thanks guys!

dchvn pushed a commit to dchvn/spark that referenced this pull request Jan 19, 2022
… slow tests

### What changes were proposed in this pull request?

This PR proposes to mark `org.apache.spark.sql.hive.execution` as slow tests to rebalance the jobs in GitHub Actions.

### Why are the changes needed?

Related to SPARK-33171 and SPARK-32884. We should rebalance both:

- "hive -slow tests": https://github.com/apache/spark/runs/4755996153?check_suite_focus=true
- "hive - other tests": https://github.com/apache/spark/runs/4755996212?check_suite_focus=true

### Does this PR introduce _any_ user-facing change?

No, dev-only.

### How was this patch tested?

CI in this PR should test it out.

Closes apache#35151 from HyukjinKwon/SPARK-37851.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@HyukjinKwon HyukjinKwon deleted the SPARK-37851 branch January 15, 2024 00:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants