Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make scope_download_classification.py robust to server errors #87

Closed
Tracked by #54
bfhealy opened this issue Sep 2, 2022 · 0 comments · Fixed by #111
Closed
Tracked by #54

Make scope_download_classification.py robust to server errors #87

bfhealy opened this issue Sep 2, 2022 · 0 comments · Fixed by #111
Assignees
Labels
enhancement New feature or request

Comments

@bfhealy
Copy link
Collaborator

bfhealy commented Sep 2, 2022

The scope_upload_classification.py and fritz.py code was recently updated to handle certain errors that pertain to brief interruptions in the connection to Fritz. We should do the same for the download script, which currently fails and does not save any output in the case of a single interruption to the connection.

Feature Summary
Added robustness to scope_download_classification.py

Usage / behavior

  • Upon a connection error, retry the API call a specified number of times.
  • Establish checkpoints to occasionally save downloaded data so all progress is not lost if the download loop is broken.
  • Allow the user to continue an interrupted download from a specified source

Implementation details

  • The api calls in scope_upload_classification.py and fritz.py have examples of handling server connection errors.
@bfhealy bfhealy added the enhancement New feature or request label Sep 2, 2022
@bfhealy bfhealy mentioned this issue Sep 2, 2022
48 tasks
@guiga004 guiga004 self-assigned this Sep 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants