add compression support

[dontreboot]

Current plugin doesn't support any type of compression. I am also using s3 output which supports compression and that plugin provides better throughput. Is there a plan to add compression support for this plugin?

[logachev]

@dontreboot are you looking for something similar to this? https://github.com/htgc/fluent-plugin-azurestorage

This plugin is using append blobs, so I don't see a way to implement compression easily.. Appending compressed data each time doesn't seem right. Does s3 plugin creates new blobs or appends data to existing?

The plugin I referenced uses block blobs, so it has a support for the compression.

[logachev]

S3 output plugin (https://docs.fluentd.org/output/s3) seems to create new blobs for each chunk of logs, similar to https://github.com/htgc/fluent-plugin-azurestorage this plugin.

It is not possible with Append Blobs.