-
Notifications
You must be signed in to change notification settings - Fork 484
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
File upload: Investigate cleaning up /temp directory more proactively through app. #2140
Comments
Definitely related to #2125, as the caching may have caused this. There may be a difference between the directory for uploaded files before they are saved and the temporary directory in which processing of files takes place. |
While a cleaner job works, I've noticed that after files have been moved from the first state, currently-being-uploaded, to the second state, uploaded-but-not-saved, they lose the 'tmp' and 'upload' head and tail. But, after being saved, they're copied (not moved) to their destination directory, so they sit in temp taking up space. I would think at least files that have been successfully placed in their final location would be automatically removed. |
Am I reading correctly that old files in files.dir/temp should be safe to delete? By old, I mean a month or more. |
Don, my experience with watching this directory is that files that are successfully uploaded and saved are removed from that directory and files that remain were orphaned due to some failure. I am not sure about the behavior tomck is describing -I have not scrutinized it that carefully but I think old files are safe to delete. @landreev may have additional info. |
@kcondon in #5089 @qqmyers suggests his PR #5091 which was merged in 4.9.3 is "probably" a solution for this issue.
|
To focus on the most important features and bugs, we are closing issues created before 2020 (version 5.0) that are not new feature requests with the label 'Type: Feature'. If you created this issue and you feel the team should revisit this decision, please reopen the issue and leave a comment. |
Recently we found the /temp directory under the files storage directory was consuming a large amount of space and seemed to be in part related to failed file uploads and ingests.
Can we investigate cleaning this up more proactively so we don't use up a lot of disk space?
We have put a cleaner job in place in the meantime for files older than 1 day.
The text was updated successfully, but these errors were encountered: