pyarrow.fs.S3FileSystem pass extra kwargs i.e ACL

[ryanhaarmann]

Is there a way to set specific ACL args to the new written files via the S3FileSystem? We have a situation where the writer/read role groups do not have access unless specified during the write process.

Example of how we update with s3fs:

s3fs.S3FileSystem(
    s3_additional_kwargs={'ACL': 'bucket-owner-full-control'}
)

or with boto:

extra_args.update({"ACL": "bucket-owner-full-control"})
boto3.s3.transfer.S3Transfer(...).upload_file(extra_args=extra_args)

or

s3.Object(my_bucket_name, my_key_path).put(Body=my_body, ACL='bucket-owner-full-control')

[westonpace]

There is no way to do this today but it sounds like a very reasonable feature to suggest. In particular, it should be straightforward to pass a "default" ACL that gets applied to all files created by the filesystem. Can you please create a JIRA?

[ryanhaarmann]

JIRA issue created
https://issues.apache.org/jira/browse/ARROW-12719

[kou]

Thanks!