Skip to content

Adds logging at INFO for all creation, deletion and copying of files in WriteFiles#4103

Closed
jkff wants to merge 1 commit intoapache:masterfrom
jkff:write-files-logging
Closed

Adds logging at INFO for all creation, deletion and copying of files in WriteFiles#4103
jkff wants to merge 1 commit intoapache:masterfrom
jkff:write-files-logging

Conversation

@jkff
Copy link
Contributor

@jkff jkff commented Nov 9, 2017

This will help with debugging issues such as https://stackoverflow.com/questions/47113773/dataflow-2-1-0-streaming-application-is-not-cleaning-temp-folders/47142671

The amount of logging, I believe, should be reasonable: it's several messages per output file (not per element or anything like that): when the temp file is created, successfully closed, deleted on error, copied to final location, and deleted after copying. This should allow tracing everything that happens to suspicious files.

R: @chamikaramj

@chamikaramj
Copy link
Contributor

LGTM

@asfgit asfgit closed this in 867d816 Nov 9, 2017
@jkff jkff deleted the write-files-logging branch November 9, 2017 05:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants