sql/stats: TestCreateStatsProgress failed

[cockroach-teamcity]

sql/stats.TestCreateStatsProgress failed on release-24.1 @ 7185e6c311160061e0753e9ef1d66e8bb828fc98:

Fatal error:

panic: test timed out after 41m37s
running tests:
	TestCreateStatsProgress (41m33s)

Stack:

goroutine 17688 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x265
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x45

Log preceding fatal error

* github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func3({0xb152118, 0xc0040d3c80}, {0x8277340, 0xc003216240}, 0xc00450aee0, 0xc005511000)
* 	github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:169 +0xf1
* google.golang.org/grpc.getChainUnaryHandler.func1({0xb152118, 0xc0040d3c80}, {0x8277340, 0xc003216240})
* 	google.golang.org/grpc/external/org_golang_google_grpc/server.go:1163 +0x12d
* github.com/cockroachdb/cockroach/pkg/rpc.kvAuth.unaryInterceptor({0xc0028b6000?, {{0x0?}, {0xb18e5d0?, 0xc003240070?}}}, {0xb152118, 0xc0040d3bc0}, {0x8277340, 0xc003216240}, 0xc00450aee0, 0xc005510fc0)
* 	github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/auth.go:95 +0x2b7
* google.golang.org/grpc.getChainUnaryHandler.func1({0xb152118, 0xc0040d3bc0}, {0x8277340, 0xc003216240})
* 	google.golang.org/grpc/external/org_golang_google_grpc/server.go:1163 +0x12d
* github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1.1({0xb152118, 0xc0040d3bc0})
* 	github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:136 +0x6b
* github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0xc0017eadc0, {0xb152118, 0xc0040d3bc0}, {0xea32bc0?, 0xc005510f80?}, 0xc0081d3700)
* 	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:337 +0x186
* github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1({0xb152118, 0xc0040d3bc0}, {0x8277340, 0xc003216240}, 0xc00450aee0, 0xc005510f80)
* 	github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:134 +0x151
* google.golang.org/grpc.NewServer.chainUnaryServerInterceptors.chainUnaryInterceptors.func1({0xb152118, 0xc0040d3bc0}, {0x8277340, 0xc003216240}, 0xc00450aee0, 0xc000f5cde0)
* 	google.golang.org/grpc/external/org_golang_google_grpc/server.go:1154 +0xe8
* github.com/cockroachdb/cockroach/pkg/kv/kvpb._Internal_Batch_Handler({0x8259020, 0xc003aa0808}, {0xb152118, 0xc0040d3bc0}, 0xc002d65b20, 0xc003293020)
* 	github.com/cockroachdb/cockroach/pkg/kv/kvpb/bazel-out/k8-fastbuild/bin/pkg/kv/kvpb/kvpb_go_proto_/github.com/cockroachdb/cockroach/pkg/kv/kvpb/api.pb.go:10586 +0x1f4
* google.golang.org/grpc.(*Server).processUnaryRPC(0xc0063303c0, {0xb19f200, 0xc0066fc340}, 0xc0032c2360, 0xc00170adb0, 0xe66b120, 0x0)
* 	google.golang.org/grpc/external/org_golang_google_grpc/server.go:1336 +0x1814
* google.golang.org/grpc.(*Server).handleStream(0xc0063303c0, {0xb19f200, 0xc0066fc340}, 0xc0032c2360, 0x0)
* 	google.golang.org/grpc/external/org_golang_google_grpc/server.go:1704 +0x1013
* google.golang.org/grpc.(*Server).serveStreams.func1.2()
* 	google.golang.org/grpc/external/org_golang_google_grpc/server.go:965 +0xe5
* created by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 3755
* 	google.golang.org/grpc/external/org_golang_google_grpc/server.go:963 +0x4a8
* 
* goroutine 14338 [sync.Cond.Wait, 2 minutes]:
* sync.runtime_notifyListWait(0xc0090820a8, 0x1f4)
* 	GOROOT/src/runtime/sema.go:569 +0x159
* sync.(*Cond).Wait(0xc009082098)
* 	GOROOT/src/sync/cond.go:70 +0x75
* github.com/cockroachdb/pebble/record.(*flusherCond).Wait(...)
* 	github.com/cockroachdb/pebble/record/external/com_github_cockroachdb_pebble/record/log_writer.go:369
* github.com/cockroachdb/pebble/record.(*LogWriter).flushLoop(0xc009082000, {0xc0047d7368?, 0x7b32160?})
* 	github.com/cockroachdb/pebble/record/external/com_github_cockroachdb_pebble/record/log_writer.go:643 +0xb79
* runtime/pprof.Do({0xb151f48, 0xfbfca80}, {{0xc000d59460?, 0xc00797b260?, 0xc002bce680?}}, 0xc00644afc0)
* 	GOROOT/src/runtime/pprof/runtime.go:51 +0x118
* github.com/cockroachdb/pebble/record.NewLogWriter.func2()
* 	github.com/cockroachdb/pebble/record/external/com_github_cockroachdb_pebble/record/log_writer.go:562 +0x92
* created by github.com/cockroachdb/pebble/record.NewLogWriter in goroutine 1955
* 	github.com/cockroachdb/pebble/record/external/com_github_cockroachdb_pebble/record/log_writer.go:561 +0x8e5
* 
* goroutine 14305 [select]:
* github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker.func1()
* 	github.com/cockroachdb/pebble/vfs/external/com_github_cockroachdb_pebble/vfs/disk_health.go:243 +0x19b
* created by github.com/cockroachdb/pebble/vfs.(*diskHealthCheckingFile).startTicker in goroutine 1955
* 	github.com/cockroachdb/pebble/vfs/external/com_github_cockroachdb_pebble/vfs/disk_health.go:238 +0xad
* 
*

Parameters:

• attempt=1
• race=true
• run=1
• shard=7

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

• sql/stats: TestCreateStatsProgress failed #121770 sql/stats: TestCreateStatsProgress failed [C-test-failure O-robot T-sql-queries branch-master]

/cc @cockroachdb/sql-queries

This test on roachdash | Improve this report!

Jira issue: CRDB-38022

[michae2]

dup of #121770