Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-42861][SQL] Use private[sql] instead of protected[sql] to avoid generating API doc #40541

Closed
wants to merge 1 commit into from

Conversation

cloud-fan
Copy link
Contributor

@cloud-fan cloud-fan commented Mar 24, 2023

What changes were proposed in this pull request?

This is the only issue I found during SQL module API auditing via apache/spark-website@6159860 . Somehow protected[sql] also generates API doc which is unexpected. private[sql] solves the problem and I generated doc locally to verify it.

Another API issue has been fixed by #40499

Why are the changes needed?

fix api doc

Does this PR introduce any user-facing change?

no

How was this patch tested?

N/A

@github-actions github-actions bot added the SQL label Mar 24, 2023
@cloud-fan
Copy link
Contributor Author

@xinrong-meng

@@ -64,7 +64,7 @@ class RuntimeConfig private[sql](sqlConf: SQLConf = new SQLConf) {
/**
* Sets the given Spark runtime configuration property.
*/
protected[sql] def set[T](entry: ConfigEntry[T], value: T): Unit = {
private[sql] def set[T](entry: ConfigEntry[T], value: T): Unit = {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Other places have been protected[sql] since 2016. Do we also need to weaken the access scope in this one?

Copy link
Contributor Author

@cloud-fan cloud-fan Mar 24, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can't find any difference between private[sql] and protected[sql] since it's meaningless to extend RuntimeConfig.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Got it

@yaooqinn yaooqinn closed this in f7421b4 Mar 24, 2023
yaooqinn pushed a commit that referenced this pull request Mar 24, 2023
…d generating API doc

### What changes were proposed in this pull request?

This is the only issue I found during SQL module API auditing via apache/spark-website@6159860 . Somehow `protected[sql]` also generates API doc which is unexpected. `private[sql]` solves the problem and I generated doc locally to verify it.

Another API issue has been fixed by #40499

### Why are the changes needed?

fix api doc

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

N/A

Closes #40541 from cloud-fan/auditing.

Authored-by: Wenchen Fan <wenchen@databricks.com>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit f7421b4)
Signed-off-by: Kent Yao <yao@apache.org>
@yaooqinn
Copy link
Member

thanks, merged to master and 3.4

snmvaughan pushed a commit to snmvaughan/spark that referenced this pull request Jun 20, 2023
…d generating API doc

### What changes were proposed in this pull request?

This is the only issue I found during SQL module API auditing via apache/spark-website@6159860 . Somehow `protected[sql]` also generates API doc which is unexpected. `private[sql]` solves the problem and I generated doc locally to verify it.

Another API issue has been fixed by apache#40499

### Why are the changes needed?

fix api doc

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

N/A

Closes apache#40541 from cloud-fan/auditing.

Authored-by: Wenchen Fan <wenchen@databricks.com>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit f7421b4)
Signed-off-by: Kent Yao <yao@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
3 participants