New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BEAM-7424] Retry HTTP 429 errors from GCS #8933
Conversation
match Python SDK retrying threshold to Java SDK threshold.
R: @chamikaramj |
CC: @robinyqiu |
@@ -52,7 +52,7 @@ def __init__(self, url='', credentials=None, | |||
super(StorageV1, self).__init__( | |||
url, credentials=credentials, | |||
get_credentials=get_credentials, http=http, model=model, | |||
log_request=log_request, log_response=log_response, | |||
log_request=log_request, log_response=log_response, num_retries=20, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This client is autogenerated so this code might get replaced when this client is generated next time. Can you also send a PR to apitools so that the default number of retries is increased for the GCS client.
LGTM. Thanks. |
Run Python PreCommit |
run python precommit |
Run Python PreCommit |
4 similar comments
Run Python PreCommit |
Run Python PreCommit |
Run Python PreCommit |
Run Python PreCommit |
matching Python SDK GCS retrying threshold to Java SDK GCS retrying threshold.
For Java SDK, retrying threshold for GCS is 15 min. To match the similar threshold in Python SDK, the maximum number of retry is increased to 20.
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
R: @username
).[BEAM-XXX] Fixes bug in ApproximateQuantiles
, where you replaceBEAM-XXX
with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.Post-Commit Tests Status (on master branch)
Pre-Commit Tests Status (on master branch)
See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.