-
-
Notifications
You must be signed in to change notification settings - Fork 127
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Stream ZIP exports to S3 #448
Labels
Comments
In our sights: kobocat/onadata/libs/utils/export_tools.py Lines 843 to 847 in 7957abd
|
I think I'm hitting this again: jschneier/django-storages#449 |
Will need to use my fork until jschneier/django-storages#504 is merged. |
jnm
added a commit
that referenced
this issue
May 31, 2018
without using temporary files. Use a custom fork of django-storages that properly supports multipart uploads. Increase the default S3 buffer size to 50 megabytes. Fixes #448.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Right now, the ZIP export process looks like:
/tmp/
;These temporary ZIP files are often exhausting our servers' disk space and causing many wasted hours. It's time to stop the madness.
The text was updated successfully, but these errors were encountered: