Skip to content

reduce threads running on upload and reraise error from tenacity on upload methods#228

Merged
parthshahva merged 1 commit intomasterfrom
reduce-threads-and-reraise-error
Feb 12, 2019
Merged

reduce threads running on upload and reraise error from tenacity on upload methods#228
parthshahva merged 1 commit intomasterfrom
reduce-threads-and-reraise-error

Conversation

@parthshahva
Copy link
Copy Markdown
Contributor

Users have reported issues with too many threads running. This fix reduces the number of threads running as a relationship with cpu count. This PR also adds reraise=True to all retries to ensure all errors are logged appropriately.

@parthshahva parthshahva changed the title reduce threads running on upload and reraise error from Tenacy on upload methods reduce threads running on upload and reraise error from tenacity on upload methods Feb 7, 2019
@codecov-io
Copy link
Copy Markdown

codecov-io commented Feb 7, 2019

Codecov Report

Merging #228 into master will increase coverage by 0.51%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #228      +/-   ##
==========================================
+ Coverage   83.39%   83.91%   +0.51%     
==========================================
  Files          37       37              
  Lines        1554     1554              
==========================================
+ Hits         1296     1304       +8     
+ Misses        258      250       -8
Impacted Files Coverage Δ
hca/upload/s3_agent.py 68% <100%> (ø) ⬆️
hca/upload/api_client.py 67.39% <100%> (ø) ⬆️
hca/util/pool.py 91.17% <100%> (ø) ⬆️
hca/dss/__init__.py 88.88% <0%> (+4.93%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 926de7f...4f59569. Read the comment docs.

@parthshahva parthshahva merged commit 0d451f0 into master Feb 12, 2019
@parthshahva parthshahva deleted the reduce-threads-and-reraise-error branch February 12, 2019 22:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants