SPARK-1178: missing document of spark.scheduler.revive.interval #74

Closed
wants to merge 1 commit into
from

Conversation

Projects
None yet
3 participants
@AmplabJenkins

This comment has been minimized.

Show comment Hide comment
@AmplabJenkins

AmplabJenkins Mar 4, 2014

Merged build triggered.

Merged build triggered.

@AmplabJenkins

This comment has been minimized.

Show comment Hide comment
@AmplabJenkins

AmplabJenkins Mar 4, 2014

Merged build started.

Merged build started.

@AmplabJenkins

This comment has been minimized.

Show comment Hide comment
@AmplabJenkins

AmplabJenkins Mar 4, 2014

Merged build finished.

Merged build finished.

@AmplabJenkins

This comment has been minimized.

Show comment Hide comment
@AmplabJenkins

AmplabJenkins Mar 4, 2014

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12991/

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/12991/

@rxin

This comment has been minimized.

Show comment Hide comment
@rxin

rxin Mar 4, 2014

Contributor

Thanks. Merged.

Contributor

rxin commented Mar 4, 2014

Thanks. Merged.

@asfgit asfgit closed this in 1865dd6 Mar 4, 2014

@CodingCat CodingCat deleted the CodingCat:SPARK-1178 branch Mar 17, 2014

jhartlaub referenced this pull request in jhartlaub/spark May 27, 2014

Merge pull request #74 from rxin/kill
Job cancellation via job group id.

This PR adds a simple API to group together a set of jobs belonging to a thread and threads spawned from it. It also allows the cancellation of all jobs in this group.

An example:

    sc.setJobDescription("this_is_the_group_id", "some job description")
    sc.parallelize(1 to 10000, 2).map { i => Thread.sleep(10); i }.count()

In a separate thread:

    sc.cancelJobGroup("this_is_the_group_id")

(cherry picked from commit 599dcb0)
Signed-off-by: Reynold Xin <rxin@apache.org>

CrazyJvm added a commit to CrazyJvm/spark that referenced this pull request Jun 1, 2014

SPARK-1178: missing document of spark.scheduler.revive.interval
https://spark-project.atlassian.net/browse/SPARK-1178

The configuration on spark.scheduler.revive.interval is undocumented but actually used

https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala#L64

Author: CodingCat <zhunansjtu@gmail.com>

Closes #74 from CodingCat/SPARK-1178 and squashes the following commits:

783ec69 [CodingCat] missing document of spark.scheduler.revive.interval

clockfly added a commit to clockfly/spark that referenced this pull request Sep 22, 2016

[SPARK-17188][SQL] Moves class QuantileSummaries to project catalyst …
…for implementing percentile_approx

This is cherry-pick of open source master branch (hash: cc33460)

## What changes were proposed in this pull request?

This is a sub-task of [SPARK-16283](https://issues.apache.org/jira/browse/SPARK-16283) (Implement percentile_approx SQL function), which moves class QuantileSummaries to project catalyst so that it can be reused when implementing aggregation function `percentile_approx`.

This PR only does class relocation, class implementation is not changed.

Author: Sean Zhong <seanzhongdatabricks.com>

Author: Sean Zhong <seanzhong@databricks.com>

Closes #74 from clockfly/move_quantile_summaries.

robert3005 pushed a commit to robert3005/spark that referenced this pull request Jan 12, 2017

cenyuhai added a commit to cenyuhai/spark that referenced this pull request Oct 8, 2017

Merge branch 'SPARK-20865' into 'spark_2.1'
[SPARK-20865] Structured streaming dataframe cache、unpersist报错

structured streaming dataset cache 会报错,应当给个log告警忽略cache,unpersist等操作。
resolve #74 

See merge request !65

jlopezmalla-stratio pushed a commit to jlopezmalla-stratio/spark that referenced this pull request Nov 3, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment