-
Notifications
You must be signed in to change notification settings - Fork 341
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
move get_s3_connection, reduce complexity and increase coverage #1139
move get_s3_connection, reduce complexity and increase coverage #1139
Conversation
This comment was marked as outdated.
This comment was marked as outdated.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm glad to see this being refactored. Couple of minor comments.
recheck (wanted to see if the tests would timeout) |
0c8f0ba
to
931fbf9
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not worked my way through the unit tests yet, early comments.
f507e9e
to
5697191
Compare
9c8f2bd
to
f2fc643
Compare
0ae6e58
to
7cafad8
Compare
s3_object - fix MemoryError when downloading large files SUMMARY fixes: #2107 The refactor in #1139 is triggering a full download of the file into memory when downloading files, this downloaded content was then being thrown away. ISSUE TYPE Bugfix Pull Request COMPONENT NAME s3_object ADDITIONAL INFORMATION Reviewed-by: Alina Buzachis Reviewed-by: Bikouo Aubin
s3_object - fix MemoryError when downloading large files SUMMARY fixes: #2107 The refactor in #1139 is triggering a full download of the file into memory when downloading files, this downloaded content was then being thrown away. ISSUE TYPE Bugfix Pull Request COMPONENT NAME s3_object ADDITIONAL INFORMATION Reviewed-by: Alina Buzachis Reviewed-by: Bikouo Aubin (cherry picked from commit 4829217)
[PR #2108/48292178 backport][stable-8] s3_object - fix MemoryError when downloading large files This is a backport of PR #2108 as merged into main (4829217). SUMMARY fixes: #2107 The refactor in #1139 is triggering a full download of the file into memory when downloading files, this downloaded content was then being thrown away. ISSUE TYPE Bugfix Pull Request COMPONENT NAME s3_object ADDITIONAL INFORMATION Reviewed-by: Mark Chappell
SUMMARY
get_s3_connection
is duplicated into moduless3_object
ands3_object_info
, the goal of this pull request is to move to a single place, reduce code complexity and increase coverageISSUE TYPE
COMPONENT NAME
ADDITIONAL INFORMATION