dx-download-agent inspect when file has been removed from the download directory. Additionally re-create the file when running
dx-download-agent download with an existing metadata DB.
Merge manifest scripts to
create_manifest.py. Only populate the manifest with objects in a
closed state and only retrieve the necessary describe fields.
file-xxxx/download call if running inside a job and
DX_DXDA_DOWNLOAD_URI environment variable is set. Reduces # of api calls to limit throttling from the backend.
/system/findDataObjects with scoped project-id to reduce API load when getting file part information in the case of an incomplete manifest.
Retry up to 10 times for failed describe requests. Increase the dx API timeout from 2 to 5 minutes. Fix logging of failed requests.
Do not attempt to close response body when error returned during request. Build and tag docker image on push to master with github actions.
This release fixes downloading non-public symlinks. #34 should also finally be resolved.
This release allows more aspects of the DNAnexus environment to be exposed to the client so that it can not only be used as a client on machines separate from the platform, but also within DNAnexus jobs.
Added a deadline for downloading any part of a file. If a part cannot be downloaded by this time, the program will attempt to restart downloading the whole part. This should help improve issues if downloading a part hangs for any reason. This version is backwards compatible with previous versions so you should be able to swap it out for an ongoing download.
MD5sum of tarball: 1ca28c56bcc992e6f052d304bf4264b4