[Spark][Bug]: The read and write authentication user are different in Spark when using mixed Iceberg format #1069
Labels
module:mixed-spark
Spark module for Mixed Format
priority:blocker
security, data-loss, correctness, etc.
type:bug
Something isn't working
Milestone
What happened?
When using mixed Iceberg format, Spark writer using the authentication user in SparkContext, but reader using the authentication user in arctic. So the written file cannot be read
Affects Versions
0.4.1
What engines are you seeing the problem on?
Spark
How to reproduce
step1: use mixed iceberg catalog and configure authenticated users in the arctic
step2: use different authentication users to write data using spark
step3: execute select
tips:The permission of the read authentication user is smaller than that of the write authentication user
Relevant log output
No response
Anything else
No response
Code of Conduct
The text was updated successfully, but these errors were encountered: