Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-23670][SQL] Fix memory leak on SparkPlanGraphWrapper #20813

Closed
wants to merge 1 commit into from

Conversation

myroslavlisniak
Copy link
Contributor

@myroslavlisniak myroslavlisniak commented Mar 13, 2018

What changes were proposed in this pull request?

Clean up SparkPlanGraphWrapper objects from InMemoryStore together with cleaning up SQLExecutionUIData

How was this patch tested?

existing unit test was extended to check also SparkPlanGraphWrapper object count

@vanzin

@vanzin
Copy link
Contributor

vanzin commented Mar 13, 2018

ok to test

@SparkQA
Copy link

SparkQA commented Mar 13, 2018

Test build #88210 has finished for PR 20813 at commit f866701.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Mar 14, 2018

Test build #88232 has finished for PR 20813 at commit c5172eb.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@vanzin
Copy link
Contributor

vanzin commented Mar 16, 2018

I forgot to publish my comment above when I looked at this 2 days ago, so I'll fix it during merge.

Merging to master / 2.3.

asfgit pushed a commit that referenced this pull request Mar 16, 2018
Clean up SparkPlanGraphWrapper objects from InMemoryStore together with cleaning up SQLExecutionUIData
existing unit test was extended to check also SparkPlanGraphWrapper object count

vanzin

Author: myroslavlisniak <acnipin@gmail.com>

Closes #20813 from myroslavlisniak/master.

(cherry picked from commit c2632ed)
Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com>
@asfgit asfgit closed this in c2632ed Mar 16, 2018
mstewart141 pushed a commit to mstewart141/spark that referenced this pull request Mar 24, 2018
Clean up SparkPlanGraphWrapper objects from InMemoryStore together with cleaning up SQLExecutionUIData
existing unit test was extended to check also SparkPlanGraphWrapper object count

vanzin

Author: myroslavlisniak <acnipin@gmail.com>

Closes apache#20813 from myroslavlisniak/master.
peter-toth pushed a commit to peter-toth/spark that referenced this pull request Oct 6, 2018
Clean up SparkPlanGraphWrapper objects from InMemoryStore together with cleaning up SQLExecutionUIData
existing unit test was extended to check also SparkPlanGraphWrapper object count

vanzin

Author: myroslavlisniak <acnipin@gmail.com>

Closes apache#20813 from myroslavlisniak/master.

(cherry picked from commit c2632ed)
Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants