Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Drop in download speed #65

Closed
lbusett opened this issue Mar 4, 2017 · 8 comments
Closed

Drop in download speed #65

lbusett opened this issue Mar 4, 2017 · 8 comments

Comments

@lbusett
Copy link
Collaborator

@lbusett lbusett commented Mar 4, 2017

From HG issue reported here, #64

With the hotfix version download speed was reduced dramatically and I got the error
Warning #messages:
1: running command '"aria2c"' had status 1

I have just downloaded the "devel" version and I am still getting the same warning message
1: running command '"aria2c"' had status 1

@lbusett
Copy link
Collaborator Author

@lbusett lbusett commented Mar 4, 2017

@hgiche

I opened a new issue. This is strange. We'll check it next week.

@lbusett
Copy link
Collaborator Author

@lbusett lbusett commented Mar 6, 2017

Hi Helene,
can you tell me if you're using ftp or http download ?

Lorenzo

@hgiche
Copy link

@hgiche hgiche commented Mar 6, 2017

Hi Lorenzo - I am using http.

@lbusett
Copy link
Collaborator Author

@lbusett lbusett commented Mar 6, 2017

On linux, I'm not seeing changes in speed nor warnings - will check on windows ASAP.

@ranghetti
Copy link
Collaborator

@ranghetti ranghetti commented Mar 7, 2017

Hi Helene,
I made some tests on this product both on Linux and Windows, without being able to reproduce this issue: download speed resulted high (normal) both with aria2c and wget. Could this issue be related to NASA server's problems, or to problems with the connection to it? Maybe check it again during next days.

Ps. recently we updated the ProdOpts file in order to shorten product names: after this update, already processed products are re-processed, since names changed. This would not have consequences on download speed, since hdf file names did not change, but could increase total processing time.

@hgiche
Copy link

@hgiche hgiche commented Mar 7, 2017

Thanks Lorenzo for looking into this issue. For one year of data (NDVI, VI quality, composite day of the year, pixel reliability, land/water flag) it is taking me approx. 16 hours and with the error message "running command '"aria2c"' had status 1"
I will try download the data on a different day later this week.

@lbusett
Copy link
Collaborator Author

@lbusett lbusett commented Mar 8, 2017

Hi Helene,

I committed a new version in devel: efbf1b4

It should solve the warning running command '"aria2c"' had status 1, and also some other problems on download (hopefully, it should also improve speed in some cases) . Try it out if you wish.

By the way: download speed from NASA server is greatly variable. As a rule of thumb, however, the highest speed should be obtained with ftp download, with aria2c option activated.

Lorenzo

@hgiche
Copy link

@hgiche hgiche commented Mar 8, 2017

Thanks Lorenzo.

@ranghetti ranghetti closed this Mar 10, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants
You can’t perform that action at this time.