Skip to content

[SPARK-45160][DOCS]Update the default value of 'spark.executor.logs.rolling.strategy'#42919

Closed
chenyu0513 wants to merge 4 commits intoapache:masterfrom
chenyu0513:branch-SPARK-45160
Closed

[SPARK-45160][DOCS]Update the default value of 'spark.executor.logs.rolling.strategy'#42919
chenyu0513 wants to merge 4 commits intoapache:masterfrom
chenyu0513:branch-SPARK-45160

Conversation

@chenyu0513
Copy link
Contributor

What changes were proposed in this pull request?
The PR updates the default value of 'spark.executor.logs.rolling.strategy in configuration.html on the website

Why are the changes needed?
The default value of 'spark.executor.logs.rolling.strategy' is '', but is not (none). The website has Inaccurate description.It can bring ambiguity.

Does this PR introduce any user-facing change?
No

How was this patch tested?
It doesn't need to.

Was this patch authored or co-authored using generative AI tooling?
No

@github-actions github-actions bot added the DOCS label Sep 14, 2023
@chenyu0513
Copy link
Contributor Author

the value on the official website (1)
the default value (1)
execute different logic

The default value will take different logic which is between "" and (none).
Please give me a review when you have time. @srowen @LuciferYang
Thank you so much.

<tr>
<td><code>spark.executor.logs.rolling.strategy</code></td>
<td>(none)</td>
<td>""</td>
Copy link
Member

@HyukjinKwon HyukjinKwon Sep 14, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then it seems like "" instead of an empty string. It is disabled by default so I think it's not super confusing?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@HyukjinKwon Thank you so much for your review.
I think it is unusual. it should be different from other situations, jush like which uses Nil on it's default value. This is just my opinion. Just like you said, it's not super confusing.
Thank you again. Please decide whether to support this pr.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You could write "" (disabled) to try to both express the default value and reaffirm what it means. But it already says the default is disabled and (none) communicates "not set to anything". I would leave it

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@srowen Thank you for your advice.
I had submit a new commit to express the default value and reaffirm the meaning.

@chenyu0513 chenyu0513 requested a review from srowen September 14, 2023 06:04
<td>
Set the strategy of rolling of executor logs. By default it is disabled. It can
be set to "time" (time-based rolling) or "size" (size-based rolling). For "time",
be set to "time" (time-based rolling) or "size" (size-based rolling) or ""(empty string). For "time",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please put space after quotes here and above. (empty string) isn't helpful, (disabled) is. Then you can remove the sentence at the end that you added.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@srowen Thank you for your advice.
I had follow your advice and adjust

@chenyu0513 chenyu0513 requested a review from srowen September 15, 2023 01:34
<tr>
<td><code>spark.executor.logs.rolling.strategy</code></td>
<td>(none)</td>
<td>""(disabled)</td>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You didn't fix this one

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@srowen Sorry about that.
I had fix it

@chenyu0513 chenyu0513 requested a review from srowen September 15, 2023 02:18
@srowen
Copy link
Member

srowen commented Sep 16, 2023

Merged to master
You reused a JIRA, when this should use a new JIRA.
They're really closely related so it's OK here, but you should edit the JIRA to describe the second change you made, and keep separate changes separated in the future

@srowen srowen closed this in 3397982 Sep 16, 2023
@chenyu0513 chenyu0513 changed the title [SPARK-45146][DOCS]Update the default value of 'spark.executor.logs.rolling.strategy' [SPARK-45160][DOCS]Update the default value of 'spark.executor.logs.rolling.strategy' Sep 18, 2023
@chenyu0513
Copy link
Contributor Author

@srowen
I had use a new issure.
https://issues.apache.org/jira/browse/SPARK-45160

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants