Large memory usage when downloading large files

[Danielv123]

Every time a download of a large file is initiated (~800 mb) goStatic consumes large amounts of ram for a while.

Every time a request is initiated shows up as red in the top graph. The bottom graph is container memory usage in a range of 0 - 1 GB.

[piranha]

Hm, interesting! How do you download a file with gostatic?

[Danielv123]

I have a folder on my site called "archive", where I store large zips of data. Navigating to http://site/archive gives me a nice interface by default for downloading files, much like how FTP is handled.

[piranha]

Okay, but how is gostatic involved in that?

[Danielv123]

You must have missunderstood what I said. The entire server side part of the download is handled by gostatic. The purple line in the graph above is the memory usage of my gostatic docker container, not FTP or other services. This leads me to think that gostatic is handling something weird, like reading the entire file into memory.

To reproduce:

run sudo docker run -d -p 1935:8043 -v /srv/goStatic:/srv/http --name goStatic pierrezemb/gostatic

Place large zip file in /srv/goStatic

Navigate to localhost:1935/largeFile.zip

Observe memory usage.

[piranha]

I think you are looking for https://github.com/PierreZ/goStatic :-)

[Danielv123]

Whoops, my mistake!