Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The script cannot handle gzip files coming from an Application Load Balancer (ALB) #1

Open
Techbrunch opened this issue May 31, 2017 · 2 comments

Comments

@Techbrunch
Copy link

@Techbrunch Techbrunch commented May 31, 2017

The new Application Loadbalancer (ALB) from AWS stores it's access logs in a slightly different format to S3 than the classic ELB.

  1. logs are written every 5 minutes now
  2. some fields are added at the beginning of each line and some at the end
  3. logs are written as gzipped streams with the ending .gz

Source: https://atombrenner.blogspot.fr/2017/02/how-to-gunzip-aws-loadbalancer-logs.html

I'll see if I can write a pull request.

@mostlyjason
Copy link

@mostlyjason mostlyjason commented May 31, 2017

Thanks for reporting this! In a few weeks we will launch an improvement to our S3 ingestion feature that will ingest ALB logs so you could wait for that feature or improve the script

@Techbrunch
Copy link
Author

@Techbrunch Techbrunch commented Jun 1, 2017

@mostlyjason Cool, we'll use that when it's available then. In the meantime, I hacked this together: srxp10@18f681f feel free to use it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.