Performance of tar_delete(), tar_destroy(), and tar_prune() on the cloud

[wlandau]

Prework

• I understand and agree to help guide.
• I understand and agree to contributing guide.
• New features take time and effort to create, and they take even more effort to maintain. So if the purpose of the feature is to resolve a struggle you are encountering personally, please consider first posting a "trouble" or "other" issue so we can discuss your use case and search for existing solutions first.

Proposal

For pipelines with thousands of targets, tar_delete() and tar_destroy() are slow because they delete each object one-by-one with a call to paws.storage::s3()$delete_object(). It would be faster to delete entire groups of objects with paws.storage::s3()$delete_objects(), plural. targets would probably need another utility in R/utils_aws.R for this, as well as similar functionality for Google Cloud.

[wlandau]

Implemented for AWS S3! The GCP/GCS case depends on cloudyr/googleCloudStorageR#188.

[wlandau]

Going to close this one unless cloudyr/googleCloudStorageR#188 provides a way to do batched deletion in GCP.