You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Looking at GzipAndPutFilesWork, it looks like GzipFileWork is run in parallel on the same files (each archive tries to compress the same bucket file for example).
I suspect this may lead to strange publish failures and even corruptions: it's possible that a gzip process is spawned right before a different archives spawns a "put" of the same file, if this happens an empty/partial file may get uploaded (also, we use stdout redirection to the final name in "process manager", not a safer "redirect to temp file + rename").
The text was updated successfully, but these errors were encountered:
Looking at
GzipAndPutFilesWork
, it looks likeGzipFileWork
is run in parallel on the same files (each archive tries to compress the same bucket file for example).I suspect this may lead to strange publish failures and even corruptions: it's possible that a gzip process is spawned right before a different archives spawns a "put" of the same file, if this happens an empty/partial file may get uploaded (also, we use stdout redirection to the final name in "process manager", not a safer "redirect to temp file + rename").
The text was updated successfully, but these errors were encountered: