Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-47224][PS][TESTS] Split test_split_apply_basic and test_split_apply_adv #45332

Closed

Conversation

zhengruifeng
Copy link
Contributor

@zhengruifeng zhengruifeng commented Feb 29, 2024

What changes were proposed in this pull request?

Split test_split_apply_basic/test_split_apply_adv and their parity tests

Why are the changes needed?

it is still slow, split it for testing parallelism

Does this PR introduce any user-facing change?

no

How was this patch tested?

ci

Was this patch authored or co-authored using generative AI tooling?

no

@zhengruifeng zhengruifeng marked this pull request as draft February 29, 2024 06:40
@zhengruifeng zhengruifeng changed the title [SPARK-47224][PS][TESTS] Split test_split_apply_basic [SPARK-47224][PS][TESTS] Split test_split_apply_basic and test_split_apply_avd Feb 29, 2024
@zhengruifeng zhengruifeng changed the title [SPARK-47224][PS][TESTS] Split test_split_apply_basic and test_split_apply_avd [SPARK-47224][PS][TESTS] Split test_split_apply_basic and test_split_apply_adv Feb 29, 2024
@zhengruifeng zhengruifeng marked this pull request as ready for review February 29, 2024 06:54
@HyukjinKwon
Copy link
Member

Merged to master.

@zhengruifeng zhengruifeng deleted the ps_test_split_apply_basic branch February 29, 2024 23:33
TakawaAkirayo pushed a commit to TakawaAkirayo/spark that referenced this pull request Mar 4, 2024
…it_apply_adv`

### What changes were proposed in this pull request?
Split `test_split_apply_basic`/`test_split_apply_adv` and their parity tests

### Why are the changes needed?
it is still slow, split it for testing parallelism

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
ci

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#45332 from zhengruifeng/ps_test_split_apply_basic.

Authored-by: Ruifeng Zheng <ruifengz@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
ericm-db pushed a commit to ericm-db/spark that referenced this pull request Mar 5, 2024
…it_apply_adv`

### What changes were proposed in this pull request?
Split `test_split_apply_basic`/`test_split_apply_adv` and their parity tests

### Why are the changes needed?
it is still slow, split it for testing parallelism

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
ci

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#45332 from zhengruifeng/ps_test_split_apply_basic.

Authored-by: Ruifeng Zheng <ruifengz@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
jpcorreia99 pushed a commit to jpcorreia99/spark that referenced this pull request Mar 12, 2024
…it_apply_adv`

### What changes were proposed in this pull request?
Split `test_split_apply_basic`/`test_split_apply_adv` and their parity tests

### Why are the changes needed?
it is still slow, split it for testing parallelism

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
ci

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#45332 from zhengruifeng/ps_test_split_apply_basic.

Authored-by: Ruifeng Zheng <ruifengz@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants