Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retry logic for the connection-oriented commands #151

Closed
arm4b opened this issue Jun 8, 2017 · 2 comments · Fixed by #192
Closed

Retry logic for the connection-oriented commands #151

arm4b opened this issue Jun 8, 2017 · 2 comments · Fixed by #192
Milestone

Comments

@arm4b
Copy link
Member

arm4b commented Jun 8, 2017

The most-frequent random error when installing StackStorm is related to installing/downloading packages or similar download-oriented operations (connection closed, 50X, SSL broken pipe, GnuTLS recv error, etc). All temporary.

Needs adding retry on failure logic where applicable.

Example: https://travis-ci.org/StackStorm/ansible-st2/jobs/240785678#L925

fatal: [localhost]: FAILED! => {"changed": true, "failed": true, "msg": "https://packagecloud.io/StackStorm/unstable/el/7/x86_64/st2mistral-2.3dev-102.x86_64.rpm: [Errno 14] curl#56 - \"TCP connection reset by peer\"\nTrying other mirror.\n\n\nError downloading packages:\n  st2mistral-2.3dev-102.x86_64: [Errno 256] No more mirrors to try.\n\n", "rc": 1, "results": ["Loaded plugins: fastestmirror, ovl\nLoading mirror speeds from cached hostfile\n * base: mirror.steadfast.net\n * epel: mirror.steadfast.net\n * extras: mirrors.gigenet.com\n * updates: ftpmirror.your.org\nResolving Dependencies\n--> Running transaction check\n---> Package st2mistral.x86_64 0:2.3dev-102 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package          Arch         Version          Repository                 Size\n================================================================================\nInstalling:\n st2mistral       x86_64       2.3dev-102       StackStorm_unstable        29 M\n\nTransaction Summary\n================================================================================\nInstall  1 Package\n\nTotal download size: 29 M\nInstalled size: 142 M\nDownloading packages:\n"]}
@arm4b
Copy link
Member Author

arm4b commented Feb 17, 2018

TASK [st2 : Install libffi-devel on EL6] ***************************************
       task path: /tmp/kitchen/roles/st2/tasks/main.yml:2
       fatal: [localhost]: FAILED! => {"changed": false, "msg": "Failure downloading http://rpmfind.net/linux/centos/6/os/x86_64/Packages/libffi-devel-3.0.5-3.2.el6.x86_64.rpm, Request failed: <urlopen error timed out>"}

@arm4b
Copy link
Member Author

arm4b commented Mar 19, 2018

 TASK [nodejs : Add nodesource key] *********************************************
       task path: /tmp/kitchen/roles/nodejs/tasks/nodejs_apt.yml:8
       fatal: [localhost]: FAILED! => {"changed": false, "msg": "Failed to download key at https://keyserver.ubuntu.com/pks/lookup?op=get&fingerprint=on&search=0x1655A0AB68576280: Connection failure: ('The read operation timed out',)"}

@arm4b arm4b added this to the v0.8.8 milestone Apr 23, 2018
arm4b pushed a commit that referenced this issue Apr 23, 2018
Add task retries in case of connection failure
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant