Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-21663][TESTS]test("remote fetch below max RPC message size") should call masterTracker.stop() in MapOutputTrackerSuite #18867

Closed
wants to merge 1 commit into from

Conversation

wangjiaochun
Copy link
Contributor

@wangjiaochun wangjiaochun commented Aug 7, 2017

Signed-off-by: 10087686 wang.jiaochun@zte.com.cn

What changes were proposed in this pull request?

After Unit tests end,there should be call masterTracker.stop() to free resource;
(Please fill in changes proposed in this fix)

How was this patch tested?

Run Unit tests;
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

Please review http://spark.apache.org/contributing.html before opening a pull request.

@kiszk
Copy link
Member

kiszk commented Aug 7, 2017

Can you update title as appropriate one?
Can you create a JIRA entry for this?

@jiangxb1987
Copy link
Contributor

This looks like a valid fix, cc @cloud-fan

@cloud-fan
Copy link
Contributor

ok to test

@cloud-fan
Copy link
Contributor

This may be ok to not have a ticket, but please update the PR title to be more concrete.

@SparkQA
Copy link

SparkQA commented Aug 8, 2017

Test build #80388 has finished for PR 18867 at commit b0c58c7.

  • This patch fails Scala style tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangjiaochun wangjiaochun changed the title MapOutputTrackerSuite Utest [SPARK-21663][TESTS]test("remote fetch below max RPC message size") should call masterTracker.stop() in MapOutputTrackerSuite Aug 9, 2017
@wangjiaochun
Copy link
Contributor Author

ok,I will update the PR title. @cloud-fan

@@ -176,7 +176,7 @@ class MapOutputTrackerSuite extends SparkFunSuite {
val masterTracker = newTrackerMaster(newConf)
val rpcEnv = createRpcEnv("spark")
val masterEndpoint = new MapOutputTrackerMasterEndpoint(rpcEnv, masterTracker, newConf)
rpcEnv.setupEndpoint(MapOutputTracker.ENDPOINT_NAME, masterEndpoint)
masterTracker.trackerEndpoint = rpcEnv.setupEndpoint(MapOutputTracker.ENDPOINT_NAME, masterEndpoint)
Copy link
Contributor

@jiangxb1987 jiangxb1987 Aug 9, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit:

    masterTracker.trackerEndpoint =
      rpcEnv.setupEndpoint(MapOutputTracker.ENDPOINT_NAME, masterEndpoint)

To fix scala style failure.

Signed-off-by: 10087686 <wang.jiaochun@zte.com.cn>
@SparkQA
Copy link

SparkQA commented Aug 9, 2017

Test build #80437 has finished for PR 18867 at commit 5fb7403.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@jiangxb1987
Copy link
Contributor

LGTM

@cloud-fan
Copy link
Contributor

thanks, merging to master/2.2

asfgit pushed a commit that referenced this pull request Aug 9, 2017
…should call masterTracker.stop() in MapOutputTrackerSuite

Signed-off-by: 10087686 <wang.jiaochunzte.com.cn>

## What changes were proposed in this pull request?
After Unit tests end,there should be call masterTracker.stop() to free resource;
(Please fill in changes proposed in this fix)

## How was this patch tested?
Run Unit tests;
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

Please review http://spark.apache.org/contributing.html before opening a pull request.

Author: 10087686 <wang.jiaochun@zte.com.cn>

Closes #18867 from wangjiaochun/mapout.

(cherry picked from commit 6426adf)
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
@asfgit asfgit closed this in 6426adf Aug 9, 2017
MatthewRBruce pushed a commit to Shopify/spark that referenced this pull request Jul 31, 2018
…should call masterTracker.stop() in MapOutputTrackerSuite

Signed-off-by: 10087686 <wang.jiaochunzte.com.cn>

## What changes were proposed in this pull request?
After Unit tests end,there should be call masterTracker.stop() to free resource;
(Please fill in changes proposed in this fix)

## How was this patch tested?
Run Unit tests;
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

Please review http://spark.apache.org/contributing.html before opening a pull request.

Author: 10087686 <wang.jiaochun@zte.com.cn>

Closes apache#18867 from wangjiaochun/mapout.

(cherry picked from commit 6426adf)
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants