Support credential vending for Spark Client (Delta tables) #3020
Description
Is your feature request related to a problem? Please describe.
When we use the Spark client for the delta table format support, we are having to configure spark with access credentials to access the underlying Storage bucket, as credential vending is not yet implemented
https://github.com/apache/polaris/blob/main/plugins/spark/v3.5/regtests/setup.sh#L165
Configuring static credentials defies the data governance goal that we use the Catalog for, therefore Credential Vending would unblock us for this case. Thanks in advance for all the support
Describe the solution you'd like
Credential Vending for the Spark client (to support delta) similar to how vending is done for Iceberg
Describe alternatives you've considered
An alternative is to configure Spark with the underlying S3 credentials (e.g. Access & Secret Key), but this is a security concern for our use case and we would like to avoid it
Additional context
No response