Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change temp file prefix used by BufferedRemoteTaskLogger #757

Merged
merged 6 commits into from
Jun 15, 2018

Conversation

muga
Copy link
Member

@muga muga commented Apr 10, 2018

This PR fixes a bug that BufferedRemoteTaskLogger cannot upload log files on S3 correctly. The BufferedRemoteTaskLogger writes logs tmp files first before uploading them on S3. The tmp file prefix uses task name, if task name is too long, it cannot create tmp files.

In this PR, the prefix is changed with combination with projectId, workflowName and sessionTime. sessionTime is formatted by ISO-8601 and used as string.

Reported on #729 and assumes #751.

@muga muga changed the title [wip] Change temp file prefix used by BufferedRemoteTaskLogger Change temp file prefix used by BufferedRemoteTaskLogger Apr 13, 2018
@muga muga changed the title Change temp file prefix used by BufferedRemoteTaskLogger [wip] Change temp file prefix used by BufferedRemoteTaskLogger Apr 24, 2018
@muga muga force-pushed the fix_s3_log_server_temp_file branch from bf69f61 to df643a5 Compare May 14, 2018 11:50
@muga muga changed the title [wip] Change temp file prefix used by BufferedRemoteTaskLogger Change temp file prefix used by BufferedRemoteTaskLogger May 14, 2018
@muga muga added this to the v0.9.26 milestone May 16, 2018
@muga muga merged commit 8d640ab into treasure-data:master Jun 15, 2018
@muga
Copy link
Member Author

muga commented Jun 15, 2018

Merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant