New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
net/http: data race involving net/http.(*http2Framer).WriteDataPadded
#58168
Comments
This may have been introduced in or around CL 456555. |
Looks like the HTTP/2 server is reading from a buffer passed to |
Found new dashboard test flakes for:
2023-01-31 19:43 linux-amd64-longtest-race go@b89a840d net/http.TestIssue4191_InfiniteGetToPutTimeout (log)
|
net/http.(*http2Framer).WriteDataPadded
and net/http_test.neverEnding.Read
net/http.(*http2Framer).WriteDataPadded
Found new dashboard test flakes for:
2023-02-01 19:47 linux-amd64-race go@ab0f0459 net/http.TestHeadResponses (log)
2023-02-01 19:47 linux-amd64-race go@ab0f0459 net/http.TestNoContentLengthIfTransferEncoding (log)
2023-02-01 19:47 linux-amd64-race go@ab0f0459 net/http.TestIssue3644 (log)
2023-02-01 21:30 darwin-amd64-race go@4b7f7eef net/http.TestTransportReadToEndReusesConn (log)
2023-02-01 21:30 darwin-amd64-race go@4b7f7eef net/http.TestServerNoDate (log)
2023-02-01 21:30 darwin-amd64-race go@4b7f7eef net/http.TestTransportIDNA (log)
2023-02-01 21:30 darwin-amd64-race go@4b7f7eef net/http.TestServerKeepAlivesEnabledResultClose (log)
|
Change https://go.dev/cl/465157 mentions this issue: |
Found new dashboard test flakes for:
2023-02-04 07:03 darwin-amd64-race go@25f5d9d4 net/http.TestTransportGzipRecursive (log)
2023-02-04 07:03 darwin-amd64-race go@25f5d9d4 net/http.TestOnlyWriteTimeout (log)
2023-02-04 07:03 darwin-amd64-race go@25f5d9d4 net/http.TestFileServerSortsNames (log)
2023-02-04 07:03 darwin-amd64-race go@25f5d9d4 net/http.TestShouldRedirectConcurrency (log)
2023-02-04 07:03 darwin-amd64-race go@25f5d9d4 net/http.TestServerIssue5953 (log)
|
Found new dashboard test flakes for:
2023-02-04 07:03 linux-amd64-longtest-race go@25f5d9d4 net/http.TestIssue4191_InfiniteGetToPutTimeout (log)
|
Found new dashboard test flakes for:
2023-02-06 04:29 freebsd-amd64-race go@def0be5e net/http.TestServeFileContentType (log)
2023-02-06 04:29 freebsd-amd64-race go@def0be5e net/http.TestFileServerMethodOptions (log)
2023-02-06 04:29 freebsd-amd64-race go@def0be5e net/http.TestFileServerSortsNames (log)
2023-02-06 04:29 freebsd-amd64-race go@def0be5e net/http.TestFileServerImplicitLeadingSlash (log)
|
Found new dashboard test flakes for:
2023-02-06 12:49 darwin-amd64-race go@a432d891 net/http.TestTimeoutHandlerRace (log)
2023-02-06 12:49 darwin-amd64-race go@a432d891 net/http.TestTransportIssue10457 (log)
2023-02-06 12:49 darwin-amd64-race go@a432d891 net/http.TestDontCacheBrokenHTTP2Conn (log)
2023-02-06 12:49 darwin-amd64-race go@a432d891 net/http.TestRequestLimit (log)
2023-02-06 13:49 darwin-amd64-race go@bf8d142b net/http.TestTransportCancelRequestInDo (log)
2023-02-06 13:49 darwin-amd64-race go@bf8d142b net/http.TestTransportCloseResponseBody (log)
2023-02-06 18:07 darwin-amd64-race go@7c1aa5d9 net/http.TestTransportClosesRequestBody (log)
2023-02-06 18:07 darwin-amd64-race go@7c1aa5d9 net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-06 18:07 darwin-amd64-race go@7c1aa5d9 net/http.TestIdentityTransferEncoding (log)
2023-02-06 18:07 darwin-amd64-race go@7c1aa5d9 net/http.TestTransportIgnore1xxResponses (log)
|
Found new dashboard test flakes for:
2023-02-07 17:08 windows-amd64-race go@9ddf748d net/http.TestOptions (log)
2023-02-07 17:08 windows-amd64-race go@9ddf748d net/http.TestContentLengthZero (log)
2023-02-07 17:08 windows-amd64-race go@9ddf748d net/http.TestCloseNotifier (log)
2023-02-07 17:08 windows-amd64-race go@9ddf748d net/http.TestTransportPersistConnLeakNeverIdle (log)
2023-02-07 17:08 windows-amd64-race go@9ddf748d net/http.TestRequestBodyLimit (log)
|
Found new dashboard test flakes for:
2023-02-07 22:22 freebsd-amd64-race go@9565d990 net/http.TestClientCopyHostOnRedirect (log)
2023-02-07 22:22 freebsd-amd64-race go@9565d990 net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-07 22:22 freebsd-amd64-race go@9565d990 net/http.TestHTTP10ConnectionHeader (log)
2023-02-07 22:22 freebsd-amd64-race go@9565d990 net/http.TestServerReaderFromOrder (log)
|
Found new dashboard test flakes for:
2023-02-08 14:52 linux-amd64-race go@1a09d57d net/http.TestCloseNotifier (log)
2023-02-08 14:52 linux-amd64-race go@1a09d57d net/http.TestServerRequestContextCancel_ServeHTTPDone (log)
2023-02-08 14:52 linux-amd64-race go@1a09d57d net/http.TestHandlerPanicWithHijack (log)
2023-02-08 14:52 linux-amd64-race go@1a09d57d net/http.TestTimeoutHandlerRace (log)
2023-02-08 14:52 linux-amd64-race go@1a09d57d net/http.TestHijackBeforeRequestBodyRead (log)
|
Found new dashboard test flakes for:
2023-02-08 18:28 darwin-amd64-race go@da937660 net/http.TestTLSHandshakeTrace (log)
2023-02-08 18:28 darwin-amd64-race go@da937660 net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-08 18:28 darwin-amd64-race go@da937660 net/http.TestIssue32441 (log)
2023-02-08 18:28 darwin-amd64-race go@da937660 net/http.TestTransportDialTLS (log)
2023-02-08 18:28 darwin-amd64-race go@da937660 net/http.TestCancelRequestWithChannelBeforeDo_Context (log)
|
Found new dashboard test flakes for:
2023-02-08 14:52 linux-amd64-longtest-race go@1a09d57d net/http.TestIssue4191_InfiniteGetToPutTimeout (log)
|
Found new dashboard test flakes for:
2023-02-09 09:33 windows-amd64-race go@fd208c88 net/http.TestServeFileFromCWD (log)
2023-02-09 09:33 windows-amd64-race go@fd208c88 net/http.TestClientTimeout_Headers (log)
2023-02-09 09:33 windows-amd64-race go@fd208c88 net/http.TestClientWrites (log)
2023-02-09 09:33 windows-amd64-race go@fd208c88 net/http.TestOmitHTTP2Vet (log)
2023-02-09 09:33 windows-amd64-race go@fd208c88 net/http.TestClientCopyHeadersOnRedirect (log)
|
Found new dashboard test flakes for:
2023-02-09 23:41 windows-amd64-race go@fb79da29 net/http.TestTransportRemovesH2ConnsAfterIdle (log)
2023-02-09 23:41 windows-amd64-race go@fb79da29 net/http.TestIssue4191_InfiniteGetToPutTimeout (log)
2023-02-09 23:41 windows-amd64-race go@fb79da29 net/http.TestTransportContentEncodingCaseInsensitive (log)
2023-02-09 23:41 windows-amd64-race go@fb79da29 net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-09 23:41 windows-amd64-race go@fb79da29 net/http.TestTransportProxyGetConnectHeader (log)
|
Found new dashboard test flakes for:
2023-02-10 15:04 freebsd-amd64-race go@79e01ab7 net/http.TestContentEncodingNoSniffing (log)
2023-02-10 15:04 freebsd-amd64-race go@79e01ab7 net/http.TestFileServerZeroByte (log)
2023-02-10 15:04 freebsd-amd64-race go@79e01ab7 net/http.TestFileServerNamesEscape (log)
|
Found new dashboard test flakes for:
2023-02-10 22:09 windows-amd64-race go@5c5f8dc9 net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-10 22:09 windows-amd64-race go@5c5f8dc9 net/http.TestTrailersClientToServer (log)
2023-02-10 22:09 windows-amd64-race go@5c5f8dc9 net/http.TestClientInsecureTransport (log)
2023-02-10 22:09 windows-amd64-race go@5c5f8dc9 net/http.TestClientWrites (log)
2023-02-10 22:09 windows-amd64-race go@5c5f8dc9 net/http.TestServerRequestContextCancel_ConnClose (log)
|
Found new dashboard test flakes for:
2023-02-10 22:09 linux-amd64-race go@5c5f8dc9 net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-10 22:09 linux-amd64-race go@5c5f8dc9 net/http.TestServerDuplicateBackgroundRead (log)
2023-02-10 22:09 linux-amd64-race go@5c5f8dc9 net/http.TestZeroLengthPostAndResponse (log)
2023-02-10 22:09 linux-amd64-race go@5c5f8dc9 net/http.TestCancelRequestWithChannelBeforeDo_Context (log)
2023-02-10 22:09 linux-amd64-race go@5c5f8dc9 net/http.TestTransportLimits1xxResponses (log)
2023-02-10 22:21 linux-amd64-race go@bd5de19b net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-10 22:21 linux-amd64-race go@bd5de19b net/http.TestTransportRejectsSignInContentLength (log)
2023-02-10 22:21 linux-amd64-race go@bd5de19b net/http.TestTransportClosesBodyOnInvalidRequests (log)
2023-02-10 22:21 linux-amd64-race go@bd5de19b net/http.TestTransportMaxConnsPerHost (log)
2023-02-11 09:26 linux-amd64-race go@e03ee85e net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-11 09:26 linux-amd64-race go@e03ee85e net/http.TestTransportProxyDialDoesNotMutateProxyConnectHeader (log)
2023-02-11 09:26 linux-amd64-race go@e03ee85e net/http.TestHeadBody (log)
2023-02-11 09:26 linux-amd64-race go@e03ee85e net/http.TestTransportRespectRequestWantsClose (log)
2023-02-11 09:26 linux-amd64-race go@e03ee85e net/http.TestTransportRangeAndGzip (log)
|
Found new dashboard test flakes for:
2023-02-11 09:26 linux-amd64-longtest-race go@e03ee85e net/http.TestServeFileFromCWD (log)
|
I'm hitting this repeatedly on TryBots even if I'm rebased on latest master. https://storage.googleapis.com/go-build-log/d6a16255/linux-amd64-race_6d494f2b.log |
Change https://go.dev/cl/467895 mentions this issue: |
Sorry about that. Rolling back https://go.dev/cl/466865 until I figure out what new race condition is being triggered here. |
This reverts CL 466865. Reason for revert: Causing trybot flakiness due to net/http race, roll back until net/http is fixed. For #58168 Change-Id: I3129deb996abe6466eccf933fe93cbbaf72ae217 Reviewed-on: https://go-review.googlesource.com/c/go/+/467895 TryBot-Result: Gopher Robot <gobot@golang.org> Auto-Submit: Damien Neil <dneil@google.com> Reviewed-by: Bryan Mills <bcmills@google.com> Run-TryBot: Damien Neil <dneil@google.com>
@FiloSottile, the stack trace from that log doesn't match the When you say “rebased on latest master”, exactly which commit had you rebased on? |
I had checked that it was more recent than the CL mentioned in #58168 (comment) but it's entirely possible I got confused, sorry about that! I re-rebased while commenting but then failed to vote Run-TryBot+1. |
Indeed, TryBots passed, sorry for the noise! |
This reverts CL 466865. Reason for revert: Causing trybot flakiness due to net/http race, roll back until net/http is fixed. For golang#58168 Change-Id: I3129deb996abe6466eccf933fe93cbbaf72ae217 Reviewed-on: https://go-review.googlesource.com/c/go/+/467895 TryBot-Result: Gopher Robot <gobot@golang.org> Auto-Submit: Damien Neil <dneil@google.com> Reviewed-by: Bryan Mills <bcmills@google.com> Run-TryBot: Damien Neil <dneil@google.com>
Found new dashboard test flakes for:
2023-02-02 15:35 darwin-amd64-race go@53372ab2 net/http.TestServeFileFromCWD (log)
2023-02-02 15:35 darwin-amd64-race go@53372ab2 net/http.TestFileServerSortsNames (log)
2023-02-02 15:35 darwin-amd64-race go@53372ab2 net/http.TestFSRedirect (log)
2023-02-02 15:35 darwin-amd64-race go@53372ab2 net/http.TestFileServerEscapesNames (log)
2023-02-02 15:35 darwin-amd64-race go@53372ab2 net/http.TestFileServerImplicitLeadingSlash (log)
2023-02-06 20:53 darwin-amd64-race go@b46e44a3 net/http.TestIssue3595 (log)
2023-02-06 20:53 darwin-amd64-race go@b46e44a3 net/http.TestTransportPrefersResponseOverWriteError (log)
2023-02-06 20:53 darwin-amd64-race go@b46e44a3 net/http.TestTransportTreat101Terminal (log)
2023-02-06 20:53 darwin-amd64-race go@b46e44a3 net/http.TestTLSHandshakeTrace (log)
2023-02-06 20:53 darwin-amd64-race go@b46e44a3 net/http.TestIssue4191_InfiniteGetToPutTimeout (log)
2023-02-06 20:56 linux-amd64-longtest-race go@e2ca417e net/http.TestIssue4191_InfiniteGetToPutTimeout (log)
2023-02-07 23:37 windows-amd64-race go@f63ee8b2 net/http.TestChunkedNoContent (log)
2023-02-07 23:37 windows-amd64-race go@f63ee8b2 net/http.TestServeWithSlashRedirectKeepsQueryString (log)
2023-02-07 23:37 windows-amd64-race go@f63ee8b2 net/http.TestServerNoDate (log)
2023-02-07 23:37 windows-amd64-race go@f63ee8b2 net/http.TestTransportConnectionCloseOnRequestDisableKeepAlive (log)
2023-02-07 23:37 windows-amd64-race go@f63ee8b2 net/http.TestServerWriteTimeout (log)
2023-02-09 20:47 darwin-amd64-race go@d57ebde9 net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-09 20:47 darwin-amd64-race go@d57ebde9 net/http.TestUnsupportedTransferEncodingsReturn501 (log)
2023-02-09 20:47 darwin-amd64-race go@d57ebde9 net/http.TestHandlerBodyClose (log)
2023-02-09 20:47 darwin-amd64-race go@d57ebde9 net/http.TestChunkedNoContent (log)
2023-02-09 20:47 darwin-amd64-race go@d57ebde9 net/http.TestTransportDialTLS (log)
2023-02-09 21:13 darwin-amd64-race go@da47cd61 net/http.TestServerContext_LocalAddrContextKey (log)
2023-02-09 21:13 darwin-amd64-race go@da47cd61 net/http.TestTransportRejectsSignInContentLength (log)
2023-02-09 21:13 darwin-amd64-race go@da47cd61 net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-09 21:13 darwin-amd64-race go@da47cd61 net/http.TestTransportRespectRequestWantsClose (log)
2023-02-10 14:29 windows-amd64-race go@7d57a9ce net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-10 14:29 windows-amd64-race go@7d57a9ce net/http.TestResponseControllerSetFutureReadDeadline (log)
2023-02-10 14:29 windows-amd64-race go@7d57a9ce net/http.TestResponseControllerHijack (log)
2023-02-10 14:29 windows-amd64-race go@7d57a9ce net/http.TestHijackBeforeRequestBodyRead (log)
2023-02-10 14:29 windows-amd64-race go@7d57a9ce net/http.TestResponseControllerSetPastReadDeadline (log)
2023-02-10 16:32 darwin-amd64-race go@6e5c2608 net/http.TestServerIssue5953 (log)
2023-02-10 16:32 darwin-amd64-race go@6e5c2608 net/http.TestDisableKeepAliveUpgrade (log)
2023-02-10 16:32 darwin-amd64-race go@6e5c2608 net/http.TestTransportClosesBodyOnError (log)
2023-02-10 16:32 darwin-amd64-race go@6e5c2608 net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-10 16:32 darwin-amd64-race go@6e5c2608 net/http.TestCaseSensitiveMethod (log)
2023-02-10 22:09 darwin-amd64-race go@5c5f8dc9 net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-10 22:09 darwin-amd64-race go@5c5f8dc9 net/http.TestServerReaderFromOrder (log)
2023-02-10 22:09 darwin-amd64-race go@5c5f8dc9 net/http.TestCloseNotifierPipelined (log)
2023-02-10 22:09 darwin-amd64-race go@5c5f8dc9 net/http.TestClientWriteShutdown (log)
2023-02-10 22:09 darwin-amd64-race go@5c5f8dc9 net/http.TestServerGracefulClose (log)
2023-02-10 22:09 linux-amd64-longtest-race go@5c5f8dc9 net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-11 09:26 darwin-amd64-race go@e03ee85e net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-11 09:26 darwin-amd64-race go@e03ee85e net/http.TestCloseNotifier (log)
2023-02-11 09:26 darwin-amd64-race go@e03ee85e net/http.TestContentLengthZero (log)
2023-02-11 09:26 darwin-amd64-race go@e03ee85e net/http.TestHijackBeforeRequestBodyRead (log)
2023-02-11 09:26 darwin-amd64-race go@e03ee85e net/http.TestServerReaderFromOrder (log)
2023-02-11 16:16 darwin-amd64-race go@261fe25c net/http.TestTransportClosesRequestBody (log)
2023-02-11 16:16 darwin-amd64-race go@261fe25c net/http.TestTransportFlushesRequestHeader (log)
2023-02-11 16:16 darwin-amd64-race go@261fe25c net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-11 16:16 darwin-amd64-race go@261fe25c net/http.TestServerRequestContextCancel_ConnClose (log)
2023-02-11 16:16 darwin-amd64-race go@261fe25c net/http.TestTransportRejectsSignInContentLength (log)
2023-02-13 19:16 darwin-amd64-race go@505325cf net/http.TestConnContextNotModifyingAllContexts (log)
2023-02-13 19:16 darwin-amd64-race go@505325cf net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-13 19:16 darwin-amd64-race go@505325cf net/http.TestTransportProxyConnectHeader (log)
2023-02-13 19:16 darwin-amd64-race go@505325cf net/http.TestServerShutdown (log)
2023-02-13 19:16 darwin-amd64-race go@505325cf net/http.TestTransportRequestWriteRoundTrip (log)
2023-02-13 19:16 linux-amd64-longtest-race go@505325cf net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-13 19:16 linux-amd64-longtest-race go@505325cf net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-13 19:16 linux-amd64-race go@505325cf net/http.TestClientTimeoutKillsConn_BeforeHeaders (log)
2023-02-13 19:16 linux-amd64-race go@505325cf net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-13 19:16 linux-amd64-race go@505325cf net/http.TestHijackBeforeRequestBodyRead (log)
2023-02-13 19:16 linux-amd64-race go@505325cf net/http.TestServerValidatesHeaders (log)
2023-02-13 19:16 linux-amd64-race go@505325cf net/http.TestServerReaderFromOrder (log)
2023-02-13 19:21 linux-amd64-longtest-race go@712c009c net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-13 19:21 linux-amd64-race go@712c009c net/http.TestIssue4191_InfiniteGetToPutTimeout (log)
2023-02-13 19:21 linux-amd64-race go@712c009c net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-02-13 19:21 linux-amd64-race go@712c009c net/http.TestFileServerNotDirError (log)
2023-02-13 19:21 linux-amd64-race go@712c009c net/http.TestServeFile (log)
2023-02-13 19:21 linux-amd64-race go@712c009c net/http.TestEarlyHintsRequest (log)
2023-02-13 19:42 darwin-amd64-race go@0b922bfa net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-13 19:42 darwin-amd64-race go@0b922bfa net/http.TestContentTypeWithVariousSources (log)
2023-02-13 19:42 darwin-amd64-race go@0b922bfa net/http.TestNoContentLengthIfTransferEncoding (log)
2023-02-13 19:42 darwin-amd64-race go@0b922bfa net/http.TestTransportRangeAndGzip (log)
2023-02-13 19:42 darwin-amd64-race go@0b922bfa net/http.TestClientTimeoutKillsConn_BeforeHeaders (log)
2023-02-13 19:42 freebsd-amd64-race go@0b922bfa net/http.TestServeFileFromCWD (log)
2023-02-13 19:42 freebsd-amd64-race go@0b922bfa net/http.TestEarlyHintsRequest (log)
2023-02-13 19:42 freebsd-amd64-race go@0b922bfa net/http.TestBadResponseAfterReadingBody (log)
2023-02-13 19:42 freebsd-amd64-race go@0b922bfa net/http.TestWriteHeaderNoCodeCheck (log)
2023-02-13 19:42 freebsd-amd64-race go@0b922bfa net/http.TestWriteHeader0 (log)
2023-02-13 19:42 linux-amd64-race go@0b922bfa net/http.TestTransportAndServerSharedBodyRace (log)
2023-02-13 19:42 linux-amd64-race go@0b922bfa net/http.TestH12_HeadContentLengthLargeBody (log)
2023-02-13 19:42 linux-amd64-race go@0b922bfa net/http.TestH12_Head_ExplicitLen (log)
2023-02-13 19:42 linux-amd64-race go@0b922bfa net/http.TestH12_ExplicitContentLength (log)
2023-02-13 19:42 linux-amd64-race go@0b922bfa net/http.TestH12_RequestContentLength_Known_Zero (log)
|
Found new dashboard test flakes for:
2023-01-31 19:45 linux-amd64-race go@780db9a6 net/http.TestUnsupportedTransferEncodingsReturn501 (log)
2023-01-31 19:45 linux-amd64-race go@780db9a6 net/http.TestIssue4191_InfiniteGetTimeout (log)
2023-01-31 19:45 linux-amd64-race go@780db9a6 net/http.TestTransportPersistConnContextLeakMaxConnsPerHost (log)
2023-01-31 19:45 linux-amd64-race go@780db9a6 net/http.TestTransportReadToEndReusesConn (log)
|
Found new dashboard test flakes for:
2023-01-31 22:06 windows-amd64-race go@a17d959d net/http.TestEmptyPasswordAuth (log)
2023-01-31 22:06 windows-amd64-race go@a17d959d net/http.TestTransportUsesTLSConfigServerName (log)
2023-01-31 22:06 windows-amd64-race go@a17d959d net/http.TestServeFileMimeType (log)
|
https://build.golang.org/log/8f9829a1eacef63f57dd92e8a7647ac7fdd04a3a:
https://build.golang.org/log/abcd1afb8c807a6e0947447747212fe2afa0183b:
The text was updated successfully, but these errors were encountered: