Add ZIP support on s3 input

[Jeppesen-io]

Add ZIP support on s3 input

My use case is the ability to process AWS billing logs

[DanielRedOak]

Another idea is to write this in as a codec so that other plugins can use the same functionality

[Jeppesen-io]

I like it, but two problems come to mind.

1. If you define a 'zip' codec, how do you set the codec inside the zip?
   Define two stages of codecs? eg. json codec inside zip codec.

2. If you're processing a 10GB ZIP, does logstash need to load that into
   RAM to process it via a codec?

On Wed, Sep 24, 2014 at 12:03 PM, DanielRedOak notifications@github.com
wrote:

Another idea is to write this in as a codec so that other plugins can use
the same functionality

—
Reply to this email directly or view it on GitHub
#1759 (comment)
.

*Nelson Jeppesen
*

[jordansissel]

For Logstash 1.5.0, we've moved all plugins to individual repositories, so I have moved this issue to logstash-plugins/logstash-input-s3#38. Let's continue the discussion there! :)