Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-30775][DOC] Improve the description of executor metrics in the monitoring documentation. #27526

Conversation

LucaCanali
Copy link
Contributor

@LucaCanali LucaCanali commented Feb 10, 2020

What changes were proposed in this pull request?

This PR (SPARK-30775) aims to improve the description of the executor metrics in the monitoring documentation.

Why are the changes needed?

Improve and clarify monitoring documentation by:

  • adding reference to the Prometheus end point, as implemented in [SPARK-29064]
  • extending the list and descripion of executor metrics, following up from [SPARK-27157]

Does this PR introduce any user-facing change?

Documentation update.

How was this patch tested?

n.a.

@LucaCanali
Copy link
Contributor Author

@dongjoon-hyun given your work on #25770 you may want to have a look at this?

@LucaCanali LucaCanali force-pushed the docPrometheusMetricsFollowupSpark29064 branch from f4b6064 to d39cead Compare February 21, 2020 09:55
@dongjoon-hyun
Copy link
Member

ok to test

docs/monitoring.md Outdated Show resolved Hide resolved
docs/monitoring.md Outdated Show resolved Hide resolved
docs/monitoring.md Outdated Show resolved Hide resolved
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This breaks the table layout of HTML.
Could you generate the html file and verify the result?

@SparkQA
Copy link

SparkQA commented Mar 30, 2020

Test build #120569 has finished for PR 27526 at commit d39cead.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Mar 30, 2020

Test build #120589 has finished for PR 27526 at commit 3ae4a14.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@LucaCanali
Copy link
Contributor Author

This breaks the table layout of HTML.
Indeed, it should be fixed now.

Could you generate the html file and verify the result?
For the moment I have checked with HTML rendering on Github and the table looks OK now.

@SparkQA
Copy link

SparkQA commented Mar 30, 2020

Test build #120594 has finished for PR 27526 at commit 0fc3f2a.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for updating, @LucaCanali . +1, LGTM.
Merged to master.
Since RC1 tag is already created, I will cherry-pick this to branch-3.0 after RC1 failure.

@LucaCanali
Copy link
Contributor Author

Thank you @dongjoon-hyun

dongjoon-hyun pushed a commit that referenced this pull request Mar 31, 2020
… monitoring documentation

### What changes were proposed in this pull request?
This PR (SPARK-30775) aims to improve the description of the executor metrics in the monitoring documentation.

### Why are the changes needed?
Improve and clarify monitoring documentation by:
- adding reference to the Prometheus end point, as implemented in [SPARK-29064]
- extending the list and descripion of executor metrics, following up from [SPARK-27157]

### Does this PR introduce any user-facing change?
Documentation update.

### How was this patch tested?
n.a.

Closes #27526 from LucaCanali/docPrometheusMetricsFollowupSpark29064.

Authored-by: Luca Canali <luca.canali@cern.ch>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit aa98ac5)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
sjincho pushed a commit to sjincho/spark that referenced this pull request Apr 15, 2020
… monitoring documentation

### What changes were proposed in this pull request?
This PR (SPARK-30775) aims to improve the description of the executor metrics in the monitoring documentation.

### Why are the changes needed?
Improve and clarify monitoring documentation by:
- adding reference to the Prometheus end point, as implemented in [SPARK-29064]
- extending the list and descripion of executor metrics, following up from [SPARK-27157]

### Does this PR introduce any user-facing change?
Documentation update.

### How was this patch tested?
n.a.

Closes apache#27526 from LucaCanali/docPrometheusMetricsFollowupSpark29064.

Authored-by: Luca Canali <luca.canali@cern.ch>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants