Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-13803] restore the changes in SPARK-3411 #11702

Closed
wants to merge 3 commits into from

Conversation

CodingCat
Copy link
Contributor

What changes were proposed in this pull request?

This patch contains the functionality to balance the load of the cluster-mode drivers among workers

This patch restores the changes in #1106 which was erased due to the merging of #731

How was this patch tested?

test with existing test cases

@SparkQA
Copy link

SparkQA commented Mar 14, 2016

Test build #53097 has finished for PR 11702 at commit c82e90f.

  • This patch fails MiMa tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@CodingCat
Copy link
Contributor Author

jenkins, retest this please

@SparkQA
Copy link

SparkQA commented Mar 14, 2016

Test build #53099 has finished for PR 11702 at commit 3e1882d.

  • This patch fails MiMa tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Mar 14, 2016

Test build #53100 has finished for PR 11702 at commit 3e1882d.

  • This patch fails MiMa tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@bwongchaowart
Copy link

Shouldn't the changes in #2436 be restored as well?

@bwongchaowart
Copy link

This is now working as expected for me. Thanks!

@SparkQA
Copy link

SparkQA commented Mar 15, 2016

Test build #53127 has finished for PR 11702 at commit 0bb54f6.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@CodingCat
Copy link
Contributor Author

@bwongchaowart thanks, @srowen it's done,

@srowen
Copy link
Member

srowen commented Mar 15, 2016

I'm going to go ahead and merge. It passes, and clearly this change was already intended to be in the source.

asfgit pushed a commit that referenced this pull request Mar 15, 2016
## What changes were proposed in this pull request?

This patch contains the functionality to balance the load of the cluster-mode drivers among workers

This patch restores the changes in #1106 which was erased due to the merging of #731

## How was this patch tested?

test with existing test cases

Author: CodingCat <zhunansjtu@gmail.com>

Closes #11702 from CodingCat/SPARK-13803.

(cherry picked from commit bd5365b)
Signed-off-by: Sean Owen <sowen@cloudera.com>
@asfgit asfgit closed this in bd5365b Mar 15, 2016
asfgit pushed a commit that referenced this pull request Mar 15, 2016
## What changes were proposed in this pull request?

This patch contains the functionality to balance the load of the cluster-mode drivers among workers

This patch restores the changes in #1106 which was erased due to the merging of #731

## How was this patch tested?

test with existing test cases

Author: CodingCat <zhunansjtu@gmail.com>

Closes #11702 from CodingCat/SPARK-13803.

(cherry picked from commit bd5365b)
Signed-off-by: Sean Owen <sowen@cloudera.com>
asfgit pushed a commit that referenced this pull request Mar 15, 2016
## What changes were proposed in this pull request?

This patch contains the functionality to balance the load of the cluster-mode drivers among workers

This patch restores the changes in #1106 which was erased due to the merging of #731

## How was this patch tested?

test with existing test cases

Author: CodingCat <zhunansjtu@gmail.com>

Closes #11702 from CodingCat/SPARK-13803.

(cherry picked from commit bd5365b)
Signed-off-by: Sean Owen <sowen@cloudera.com>
@srowen
Copy link
Member

srowen commented Mar 15, 2016

Merged to master back to 1.4

@CodingCat
Copy link
Contributor Author

thanks @srowen

roygao94 pushed a commit to roygao94/spark that referenced this pull request Mar 22, 2016
## What changes were proposed in this pull request?

This patch contains the functionality to balance the load of the cluster-mode drivers among workers

This patch restores the changes in apache#1106 which was erased due to the merging of apache#731

## How was this patch tested?

test with existing test cases

Author: CodingCat <zhunansjtu@gmail.com>

Closes apache#11702 from CodingCat/SPARK-13803.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants