Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
Memory problem downloading big resource #246
I have installed a META-SHARE node for UPC using your documentation and I am facing a problem that I am unable to solve.
I have added a big file (several GB) as a downloadable resource using storage_admin.py.
Honestly, I don't know. I would think that meta-share tries to load into memory all the file that has to be downloaded, but I don't see why would meta-share do that. Could be related to the fcgi configuration? Have I done something wrong?
We currently only have a very basic implementation for resource downloading. So, indeed, instead of streaming a downloaded resource, we currently create an
Our long-term goal is to have lighttpd take care of all resource downloads. Before we have this, we should perhaps at least make sure that larger resources can be downloaded at all, i.e., we should implement streaming in Django.