Skip to content

Comments

[SPARK-37239][YARN][TESTS][FOLLOWUP] Add UT to cover Client.prepareLocalResources with custom STAGING_FILE_REPLICATION#34531

Closed
LuciferYang wants to merge 2 commits intoapache:masterfrom
LuciferYang:SPARK-37239-followup
Closed

[SPARK-37239][YARN][TESTS][FOLLOWUP] Add UT to cover Client.prepareLocalResources with custom STAGING_FILE_REPLICATION#34531
LuciferYang wants to merge 2 commits intoapache:masterfrom
LuciferYang:SPARK-37239-followup

Conversation

@LuciferYang
Copy link
Contributor

@LuciferYang LuciferYang commented Nov 9, 2021

What changes were proposed in this pull request?

This pr add a new UT to cover o.a.s.deploy.yarn.Client.prepareLocalResources method with custom STAGING_FILE_REPLICATION configuration and change other related UTs to verify that the replication passed into the copyFileToRemote method is None explicitly.

Why are the changes needed?

Add new UT.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Pass the Jenkins or GitHub Action

@github-actions github-actions bot added the YARN label Nov 9, 2021
@LuciferYang
Copy link
Contributor Author

cc @dongjoon-hyun

@SparkQA
Copy link

SparkQA commented Nov 9, 2021

Test build #145021 has finished for PR 34531 at commit 2d22bfd.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Nov 9, 2021

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49493/

@SparkQA
Copy link

SparkQA commented Nov 9, 2021

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49493/

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you, @LuciferYang .
Merged to master

cc @sunchao

@LuciferYang LuciferYang deleted the SPARK-37239-followup branch October 22, 2023 07:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants