Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-7371][SPARK-7377][SPARK-7408] DAG visualization addendum (#5729) #5954

Closed
wants to merge 6 commits into from

Conversation

andrewor14
Copy link
Contributor

This is a follow-up patch for #5729.

[SPARK-7408] Move as much style code from JS to CSS as possible
[SPARK-7377] Fix JS error if a job / stage contains only one RDD
[SPARK-7371] Decrease emphasis on RDD on stage page as requested by @mateiz @pwendell

This patch also includes general code clean up.

Andrew Or added 5 commits May 5, 2015 21:55
The motivation of this effort is simply to increase the font size
of the cluster labels on the stage page. Unfortunately this is
more difficult than anticipated, because having larger labels
means having more space between clusters. This in turn means
implementing the necessary but missing feature directly in dagre-d3
itself.
In particular, the code that draws the cluster labels now takes
into account of the specific font-size of the label. Also, less
important functions are now grouped to the end to make it clear
that they should not be given as much attention. This makes the
code easier to follow.
@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@SparkQA
Copy link

SparkQA commented May 6, 2015

Test build #32040 has started for PR 5954 at commit f23e15b.

@andrewor14 andrewor14 changed the title [SPARK-7371][SPARK-7408] Dag visualization: less emphasis on RDDs on stage page + general code clean up [SPARK-7371][SPARK-7377][SPARK-7408] DAG visualization addendum (#5729) May 6, 2015
@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@SparkQA
Copy link

SparkQA commented May 6, 2015

Test build #32045 has started for PR 5954 at commit 3c0d4f0.

@pwendell
Copy link
Contributor

pwendell commented May 6, 2015

LGTM thanks andrew

@SparkQA
Copy link

SparkQA commented May 7, 2015

Test build #32045 has finished for PR 5954 at commit 3c0d4f0.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Merged build finished. Test FAILed.

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32045/
Test FAILed.

@SparkQA
Copy link

SparkQA commented May 7, 2015

Test build #32040 has finished for PR 5954 at commit f23e15b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Merged build finished. Test PASSed.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32040/
Test PASSed.

@andrewor14
Copy link
Contributor Author

Thanks Patrick. I'm merging this into master and 1.4.

@asfgit asfgit closed this in 8fa6829 May 7, 2015
asfgit pushed a commit that referenced this pull request May 7, 2015
)

This is a follow-up patch for #5729.

**[SPARK-7408]** Move as much style code from JS to CSS as possible
**[SPARK-7377]** Fix JS error if a job / stage contains only one RDD
**[SPARK-7371]** Decrease emphasis on RDD on stage page as requested by mateiz pwendell

This patch also includes general code clean up.

<img src="https://issues.apache.org/jira/secure/attachment/12730992/before-after.png" width="500px"></img>

Author: Andrew Or <andrew@databricks.com>

Closes #5954 from andrewor14/viz-emphasize-rdd and squashes the following commits:

3c0d4f0 [Andrew Or] Guard against JS error by rendering arrows only if needed
f23e15b [Andrew Or] Merge branch 'master' of github.com:apache/spark into viz-emphasize-rdd
565801f [Andrew Or] Clean up code
9dab5f0 [Andrew Or] Move styling from JS to CSS + clean up code
107c0b6 [Andrew Or] Tweak background color, stroke width, font size etc.
1610c62 [Andrew Or] Implement cluster padding for stage page

(cherry picked from commit 8fa6829)
Signed-off-by: Andrew Or <andrew@databricks.com>
asfgit pushed a commit that referenced this pull request May 7, 2015
jkbradley pushed a commit to jkbradley/spark that referenced this pull request May 7, 2015
@andrewor14 andrewor14 deleted the viz-emphasize-rdd branch May 7, 2015 02:52
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request May 28, 2015
…ache#5729)

This is a follow-up patch for apache#5729.

**[SPARK-7408]** Move as much style code from JS to CSS as possible
**[SPARK-7377]** Fix JS error if a job / stage contains only one RDD
**[SPARK-7371]** Decrease emphasis on RDD on stage page as requested by mateiz pwendell

This patch also includes general code clean up.

<img src="https://issues.apache.org/jira/secure/attachment/12730992/before-after.png" width="500px"></img>

Author: Andrew Or <andrew@databricks.com>

Closes apache#5954 from andrewor14/viz-emphasize-rdd and squashes the following commits:

3c0d4f0 [Andrew Or] Guard against JS error by rendering arrows only if needed
f23e15b [Andrew Or] Merge branch 'master' of github.com:apache/spark into viz-emphasize-rdd
565801f [Andrew Or] Clean up code
9dab5f0 [Andrew Or] Move styling from JS to CSS + clean up code
107c0b6 [Andrew Or] Tweak background color, stroke width, font size etc.
1610c62 [Andrew Or] Implement cluster padding for stage page
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request May 28, 2015
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
…ache#5729)

This is a follow-up patch for apache#5729.

**[SPARK-7408]** Move as much style code from JS to CSS as possible
**[SPARK-7377]** Fix JS error if a job / stage contains only one RDD
**[SPARK-7371]** Decrease emphasis on RDD on stage page as requested by mateiz pwendell

This patch also includes general code clean up.

<img src="https://issues.apache.org/jira/secure/attachment/12730992/before-after.png" width="500px"></img>

Author: Andrew Or <andrew@databricks.com>

Closes apache#5954 from andrewor14/viz-emphasize-rdd and squashes the following commits:

3c0d4f0 [Andrew Or] Guard against JS error by rendering arrows only if needed
f23e15b [Andrew Or] Merge branch 'master' of github.com:apache/spark into viz-emphasize-rdd
565801f [Andrew Or] Clean up code
9dab5f0 [Andrew Or] Move styling from JS to CSS + clean up code
107c0b6 [Andrew Or] Tweak background color, stroke width, font size etc.
1610c62 [Andrew Or] Implement cluster padding for stage page
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
…ache#5729)

This is a follow-up patch for apache#5729.

**[SPARK-7408]** Move as much style code from JS to CSS as possible
**[SPARK-7377]** Fix JS error if a job / stage contains only one RDD
**[SPARK-7371]** Decrease emphasis on RDD on stage page as requested by mateiz pwendell

This patch also includes general code clean up.

<img src="https://issues.apache.org/jira/secure/attachment/12730992/before-after.png" width="500px"></img>

Author: Andrew Or <andrew@databricks.com>

Closes apache#5954 from andrewor14/viz-emphasize-rdd and squashes the following commits:

3c0d4f0 [Andrew Or] Guard against JS error by rendering arrows only if needed
f23e15b [Andrew Or] Merge branch 'master' of github.com:apache/spark into viz-emphasize-rdd
565801f [Andrew Or] Clean up code
9dab5f0 [Andrew Or] Move styling from JS to CSS + clean up code
107c0b6 [Andrew Or] Tweak background color, stroke width, font size etc.
1610c62 [Andrew Or] Implement cluster padding for stage page
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
4 participants