Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FLUME-3083. Check byte position of file in update condition of Taildir Source #128

Closed
wants to merge 1 commit into from
Closed

Conversation

eskrm
Copy link
Contributor

@eskrm eskrm commented Apr 9, 2017

This is to resolve an edge case where events can be missed during tail file close. More details are provided at https://issues.apache.org/jira/browse/FLUME-3083.

@eskrm
Copy link
Contributor Author

eskrm commented Apr 12, 2017

@bessbd

Would you be able to help review this? Satoshi reviewed it in the linked ticket.

@bessbd
Copy link
Member

bessbd commented Apr 12, 2017

@eskrm : sure, it's on my backlog. I'll do my best to prioritise this ticket.

@bessbd
Copy link
Member

bessbd commented Apr 18, 2017

I have done a quick review, ran the tests and it all seems fine.

I'll leave some time for others to leave review comments if they have any.

…r Source

This patch addresses an edge case of the Taildir Source wherein it can miss
reading events written in the same second as the file closing.
@eskrm eskrm changed the title FLUME-3083. Change file update condition in Taildir Source from mtime to byte position FLUME-3083. Check byte position of file in update condition of Taildir Source Apr 18, 2017
@eskrm
Copy link
Contributor Author

eskrm commented Apr 18, 2017

@bessbd Thanks.

Squashed and added more detail to the commit message.

@eskrm
Copy link
Contributor Author

eskrm commented Apr 26, 2017

@bessbd Ready to merge?

@bessbd
Copy link
Member

bessbd commented Apr 27, 2017

LGTM, +1

I'm about to commit this

@asfgit asfgit closed this in dfa0627 Apr 27, 2017
@eskrm
Copy link
Contributor Author

eskrm commented Apr 27, 2017

Thanks @bessbd

@bessbd
Copy link
Member

bessbd commented Apr 27, 2017

@eskrm : thank you for the patch!

waidr pushed a commit to waidr/flume that referenced this pull request Jul 24, 2019
stream-diagnostics: fix dependency conflict
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants