Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix a few issues regarding the s3 input #16

Closed
wants to merge 3 commits into from

Conversation

ph
Copy link
Contributor

@ph ph commented Feb 17, 2015

  • Allow the user to define where the plugin should keep his temporary files
  • Bugfix, If a S3 object key exactly match the prefix we will skip it fixes Setting up a prefix in logstash make him treat it like an actual file #10
  • Use info instead of error when using a user defined sincedb_path
  • adding integration test
  • Move back the GZIP file and the normal file logic back into the plugin.

@ph
Copy link
Contributor Author

ph commented Feb 18, 2015

@purbon I wish I had your rspec presentation before writing this. Could you review/test?

@purbon
Copy link

purbon commented Feb 18, 2015

Jajaja, will do!

@suyograo
Copy link
Contributor

@purbon review?

@purbon
Copy link

purbon commented Feb 20, 2015

@suyograo will do, will do, hope to do it today.

@ph
Copy link
Contributor Author

ph commented Feb 20, 2015

We will need to yank LogStash::Codecs::GzipLines and LogStash::Codecs::Cloudfront and remove the two repositories since I have moved back the functionality into the S3 input.

https://github.com/logstash-plugins/logstash-codec-cloudfront and https://github.com/logstash-plugins/logstash-codec-gzip_lines

@purbon
Copy link

purbon commented Feb 24, 2015

@ph reviewing

else
decorate(event)

event["cloudfront_version"] = metadata[:cloudfront_version] unless metadata[:cloudfront_version].nil?
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would avoid as much as possible the usage of unless, is more clean when you use if not. But this is a personal style test.

ph added 2 commits March 4, 2015 18:10
* Allow the user to define where the plugin should keep his temporary
  files
* Bugfix, If a S3 object key exactly match the prefix we will skip it fixes logstash-plugins#10
* Use info instead of error when using a user defined sincedb_path

adding integration test
@ph
Copy link
Contributor Author

ph commented Mar 4, 2015

@purbon I did not applied all the refactoring on the spec, this PR fix a few important issues with this plugin. I have created a new ticket #19 to do the refactoring of the test suite.

@elasticsearch-bot
Copy link

Merged sucessfully into master!

@ph ph closed this in 4b99086 Mar 4, 2015
ph added a commit that referenced this pull request Mar 4, 2015
ph added a commit that referenced this pull request Mar 4, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Setting up a prefix in logstash make him treat it like an actual file
5 participants