Skip to content

[BEAM-5915] Timeout http requests, if they got stuck, at dataflow job creation time#6922

Merged
aaltay merged 2 commits into
apache:masterfrom
aaltay:timeoutf
Nov 6, 2018
Merged

[BEAM-5915] Timeout http requests, if they got stuck, at dataflow job creation time#6922
aaltay merged 2 commits into
apache:masterfrom
aaltay:timeoutf

Conversation

@aaltay
Copy link
Copy Markdown
Member

@aaltay aaltay commented Nov 2, 2018

Please add a meaningful description for your change here


Follow this checklist to help us incorporate your contribution quickly and easily:

  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

It will help us expedite review of your Pull Request if you tag someone (e.g. @username) to look at it.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- --- --- --- ---
Java Build Status Build Status Build Status Build Status Build Status Build Status Build Status Build Status
Python Build Status --- Build Status
Build Status
Build Status --- --- ---

@aaltay aaltay requested a review from udim November 2, 2018 00:41
@aaltay
Copy link
Copy Markdown
Member Author

aaltay commented Nov 2, 2018

run python postcommit

credentials = get_service_credentials()

# Use 60 second timeout avoid hangs during network flakiness.
http_client = httplib2.Http(timeout=60)
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you update the comment to reflect what kind of timeout this is?
I believe it is a timeout at the socket operation level.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aaltay
Copy link
Copy Markdown
Member Author

aaltay commented Nov 6, 2018

run python postcommit

@aaltay aaltay merged commit 41bf693 into apache:master Nov 6, 2018
kennknowles pushed a commit to kennknowles/beam that referenced this pull request Jul 17, 2019
… creation time (apache#6922)

* Timeout http requests, if they got stuck, at dataflow job creation time
kennknowles pushed a commit to kennknowles/beam that referenced this pull request Jul 17, 2019
… creation time (apache#6922)

* Timeout http requests, if they got stuck, at dataflow job creation time
@aaltay aaltay deleted the timeoutf branch December 20, 2022 16:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants