Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

crypto/tls: TestVerifyHostnameResumed consistently failing in longtest builder #32978

Closed
bcmills opened this issue Jul 8, 2019 · 4 comments

Comments

Projects
None yet
4 participants
@bcmills
Copy link
Member

commented Jul 8, 2019

crypto/tls.TestVerifyHostnameResumed is consistently failing in the linux-amd64-longtest builder.

First failure was at CL 184099, which appears to be unrelated. That suggests some sort of change in a non-hermetic dependency, or perhaps in the builder itself.

Example: https://build.golang.org/log/67d2b12bec6bf70eb818bb3246aee32990ecd9e6

--- FAIL: TestVerifyHostnameResumed (0.10s)
    --- FAIL: TestVerifyHostnameResumed/TLSv12 (0.05s)
        tls_test.go:383: Subsequent connection unexpectedly didn't resume
    --- FAIL: TestVerifyHostnameResumed/TLSv13 (0.05s)
        tls_test.go:383: Subsequent connection unexpectedly didn't resume
FAIL
FAIL	crypto/tls	0.828s

CC @agl

@dmitshur

This comment has been minimized.

Copy link
Member

commented Jul 8, 2019

I can reproduce this on macOS with Go 1.12.6.

~ $ go version
go version go1.12.6 darwin/amd64
~ $ go test -count=1 crypto/tls
--- FAIL: TestVerifyHostnameResumed (1.62s)
    --- FAIL: TestVerifyHostnameResumed/TLSv13 (0.55s)
        tls_test.go:392: Subsequent connection unexpectedly didn't resume
FAIL
FAIL	crypto/tls	2.943s
@gopherbot

This comment has been minimized.

Copy link

commented Jul 15, 2019

Change https://golang.org/cl/186239 mentions this issue: crypto/tls: remove TestVerifyHostnameResumed

@gopherbot gopherbot closed this in 20e4540 Jul 15, 2019

@gopherbot

This comment has been minimized.

Copy link

commented Jul 15, 2019

Change https://golang.org/cl/186277 mentions this issue: [release-branch.go1.12] crypto/tls: remove TestVerifyHostnameResumed

@gopherbot

This comment has been minimized.

Copy link

commented Jul 15, 2019

Change https://golang.org/cl/186279 mentions this issue: [release-branch.go1.11] crypto/tls: remove TestVerifyHostnameResumed

gopherbot pushed a commit that referenced this issue Jul 15, 2019

[release-branch.go1.12] crypto/tls: remove TestVerifyHostnameResumed
Session resumption is not a reliable TLS behavior: the server can decide
to reject a session ticket for a number of reasons, or no reason at all.
This makes this non-hermetic test extremely brittle.

It's currently broken on the builders for both TLS 1.2 and TLS 1.3, and
I could reproduce the issue for TLS 1.3 only. As I was debugging it, it
started passing entirely on my machine.

In practice, it doesn't get us any coverage as resumption is already
tested with the recorded exchange tests, and TestVerifyHostname still
provides a smoke test checking that we can in fact talk TLS.

Updates #32978

Change-Id: I63505e22ff7704f25ad700d46e4ff14850ba5d3c
Reviewed-on: https://go-review.googlesource.com/c/go/+/186239
Run-TryBot: Filippo Valsorda <filippo@golang.org>
Reviewed-by: Bryan C. Mills <bcmills@google.com>
(cherry-picked from 20e4540)
Reviewed-on: https://go-review.googlesource.com/c/go/+/186277
TryBot-Result: Gobot Gobot <gobot@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>

gopherbot pushed a commit that referenced this issue Jul 15, 2019

[release-branch.go1.11] crypto/tls: remove TestVerifyHostnameResumed
Session resumption is not a reliable TLS behavior: the server can decide
to reject a session ticket for a number of reasons, or no reason at all.
This makes this non-hermetic test extremely brittle.

It's currently broken on the builders for both TLS 1.2 and TLS 1.3, and
I could reproduce the issue for TLS 1.3 only. As I was debugging it, it
started passing entirely on my machine.

In practice, it doesn't get us any coverage as resumption is already
tested with the recorded exchange tests, and TestVerifyHostname still
provides a smoke test checking that we can in fact talk TLS.

Updates #32978

Change-Id: I63505e22ff7704f25ad700d46e4ff14850ba5d3c
Reviewed-on: https://go-review.googlesource.com/c/go/+/186239
Run-TryBot: Filippo Valsorda <filippo@golang.org>
Reviewed-by: Bryan C. Mills <bcmills@google.com>
(cherry-picked from 20e4540)
Reviewed-on: https://go-review.googlesource.com/c/go/+/186279
TryBot-Result: Gobot Gobot <gobot@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.