-
Notifications
You must be signed in to change notification settings - Fork 799
deis-builder 1.10.0 is spitting 'Failed handshake: EOF' once per ~5 seconds #4431
Comments
I haven't seen this so frequently as every five seconds, but I've at least noticed it toward the end of the trace every time I start builder. AFAICT, it's not causing any issue, but the word "error" is sufficiently alarming that I think we need to either get to the bottom of this or else silence it if it is benign. |
Could @technosophos chime in? I remember he had an answer to why this might be happening... |
Ping @technosophos--any idea why this would show up so often? |
A customer has also reported this issue in a production cluster. Need to figure out what the conditions are that provokes this, since it isn't happening on new provisions we've tested. |
Missed this one. I would guess that this is happening because something is opening an SSH connection and then immediately closing it again. Probably this is a health check. |
Here is the line emitting the error: https://github.com/deis/deis/blob/master/builder/sshd/server.go#L137 We could downgrade that to a warning if you'd like. It is, after all, not really a cause for concern if we're dealing with TCP probes that check that the port is listening, but have no intention of actually initializing an SSH session. |
Here's my SSH config:
So perhaps it's the ServerAliveInterval ? |
+1 I'm starting to have there midway during a build. Not over and over though. Any workaround yet ? |
Having same error message after stopping/starting deis-builder. Also, |
Nov 25th I created a new test Deis cluster and everything was good. This morning I started up a new Deis cluster using the same scripts as previously and I'm running into this issue. I first noticed it via what @olalonde mentioned. After the cluster was up My existing cluster is a 1.12.1 that I stood up a few weeks back and did not have this issue.
|
My issue was related to changing the AWS ELB. Port 2222 was TCP->TCP and I changed it to HTTP->HTTP when I removed proxyProtocol. This was a mistake on my part and should of been left as TCP->TCP as this is used for SSH and is unrelated to any setting of proxyProtocol. |
I did an in place upgrade to 1.21.1 and had some problem with the registry so re-installed 1.11.2 which solved the issue I was having with the builder. |
I can verify that deis-builder throws the
I haven't had time to look into it, but there was a suspicious line in the log that caught my attention: |
I'm also seeing the same behaviour on 1.12.2. It seems this is pretty well documented/understood at this point, but thought I'd add the following log in case it is helpful for anyone.
The result is intermittent failures to |
Log as seen in papertrail:
The text was updated successfully, but these errors were encountered: