Continue retrying downloads on retriable statuses#1558
Conversation
dandi/download.py
Outdated
| attempt, | ||
| exc, | ||
| ) | ||
| elif attempt >= attempts_allowed: |
There was a problem hiding this comment.
@yarikoptic Question: Shouldn't this check be at the top of the function? Otherwise, if we keep hitting, say, 500 responses, it'll keep retrying beyong the maximum number of attempts.
There was a problem hiding this comment.
indeed. But after potential increment of attempts_allowed in the "aggressive" mode.
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #1558 +/- ##
==========================================
+ Coverage 88.38% 88.53% +0.14%
==========================================
Files 78 78
Lines 10736 10735 -1
==========================================
+ Hits 9489 9504 +15
+ Misses 1247 1231 -16
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
I think this is legit, I want to propose further changes. Will follow up with a PR "shortly". |
|
🚀 PR was released in |
Closes #1556.