To push .log.gz (Application ELB) Logs to ElasticSearch

[jbontech]

Could you please give code to Push Application ELB logs ( Extention will be .log.gz) to ElasticSearch using lambda, and I try to find out in any form but no luck.
Could you please help me out to what change is necessary for this code to work with .log.gz file.
Thanks in Advance.
Regards,
JB

[jderose9]

To gunzip, you need to include the zlib library at the top:

const zlib = require('zlib');

Then in s3LogsToES() you need to pass the stream through to gunzip:

s3Stream
      .pipe(zlib.createGunzip())
      .pipe(lineStream)
      .pipe(recordStream)
      .on('data', function(parsedEntry) {
            postDocumentToES(parsedEntry, context);
      });

You will then need to replace the parser with your own or something like:
https://github.com/igtm/node-alb-log-parser