-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Closed as not planned
Description
Feature Request / Improvement
I'm using Iceberg with PySpark and am aiming to provide access to sample data hosted on S3. The S3 bucket is publicly accessible, so no Access Key ID or Secret Access Key are required for List and Get requests.
For Hadoop, I provide the following configuration:
spark.hadoop.fs.s3a.aws.credentials.provider=org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider
I don't see a way to configure Iceberg to use a particular AWSCredentialsProvider besides the following list:
| return DefaultCredentialsProvider.create(); |
Could we add one of the following configuration options?
- A credentials provider by name, like Hadoop
- The Anonymous provider
Query engine
Spark