Skip to content

AnonymousAWSCredentialsProvider Should Be Supported #5971

@ddrinka

Description

@ddrinka

Feature Request / Improvement

I'm using Iceberg with PySpark and am aiming to provide access to sample data hosted on S3. The S3 bucket is publicly accessible, so no Access Key ID or Secret Access Key are required for List and Get requests.

For Hadoop, I provide the following configuration:

spark.hadoop.fs.s3a.aws.credentials.provider=org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider

I don't see a way to configure Iceberg to use a particular AWSCredentialsProvider besides the following list:

return DefaultCredentialsProvider.create();

Could we add one of the following configuration options?

  • A credentials provider by name, like Hadoop
  • The Anonymous provider

Query engine

Spark

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions