Skip to content

[SPARK-45124][CONNET] Do not use local user ID for Local Relations#42880

Closed
HyukjinKwon wants to merge 1 commit intoapache:masterfrom
HyukjinKwon:no-local-user
Closed

[SPARK-45124][CONNET] Do not use local user ID for Local Relations#42880
HyukjinKwon wants to merge 1 commit intoapache:masterfrom
HyukjinKwon:no-local-user

Conversation

@HyukjinKwon
Copy link
Member

What changes were proposed in this pull request?

This PR removes the use of userId and sessionId in CachedLocalRelation messages and subsequently make SparkConnectPlanner use the userId/sessionId of the active session rather than the user-provided information.

Why are the changes needed?

Allowing a fetch of a local relation using user-provided information is a potential security risk since this allows users to fetch arbitrary local relations.

Does this PR introduce any user-facing change?

Virtually no. It will ignore the session id or user id that users set (but instead use internal ones that users cannot manipulate).

How was this patch tested?

Manually.

Was this patch authored or co-authored using generative AI tooling?

No.

@HyukjinKwon
Copy link
Member Author

This has to be backported to branch-3.5.

@HyukjinKwon
Copy link
Member Author

Merged to master and branch-3.5.

HyukjinKwon added a commit that referenced this pull request Sep 12, 2023
### What changes were proposed in this pull request?

This PR removes the use of `userId` and `sessionId` in `CachedLocalRelation` messages and subsequently make `SparkConnectPlanner` use the `userId`/`sessionId` of the active session rather than the user-provided information.

### Why are the changes needed?

Allowing a fetch of a local relation using user-provided information is a potential security risk since this allows users to fetch arbitrary local relations.

### Does this PR introduce _any_ user-facing change?

Virtually no. It will ignore the session id or user id that users set (but instead use internal ones that users cannot manipulate).

### How was this patch tested?

Manually.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #42880 from HyukjinKwon/no-local-user.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
(cherry picked from commit 47d801e)
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
@HyukjinKwon HyukjinKwon deleted the no-local-user branch January 15, 2024 00:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants