pkg/sql/span/span_test: TestSpanSplitterCanSplitSpan failed

[cockroach-teamcity]

pkg/sql/span/span_test.TestSpanSplitterCanSplitSpan failed on master @ 8daa6933836c8ce1108fb22bf6663117fc71599b:

Fatal error:

panic: test timed out after 4m57s
running tests:
	TestSpanSplitterCanSplitSpan (4m57s)
	TestSpanSplitterCanSplitSpan/a_INT,_b_INT,_c_INT,_UNIQUE_INDEX_i_(b)_STORING_(a,_c),_FAMILY_(a),_FAMILY_(b),_FAMILY_(c) (3m42s)

Stack:

goroutine 64699422 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x385
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x2d

Log preceding fatal error

=== RUN   TestSpanSplitterCanSplitSpan
    test_log_scope.go:170: test logs captured to: outputs.zip/logTestSpanSplitterCanSplitSpan1458543114
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected a shared process virtual cluster under test; see comment at top of test_server_shim.go for details.
=== RUN   TestSpanSplitterCanSplitSpan/a_INT,_b_INT,_c_INT,_d_INT,_PRIMARY_KEY_(a,_b),_FAMILY_(a,_b,_c),_FAMILY_(d)#01
=== RUN   TestSpanSplitterCanSplitSpan/a_INT,_b_INT,_c_INT,_d_INT,_PRIMARY_KEY_(a,_b),_FAMILY_(a,_b,_c,_d)
=== RUN   TestSpanSplitterCanSplitSpan/a_INT,_b_INT,_c_INT,_INDEX_i_(b)_STORING_(a,_c),_FAMILY_(a),_FAMILY_(b),_FAMILY_(c)
=== RUN   TestSpanSplitterCanSplitSpan/a_INT,_b_INT,_c_INT,_UNIQUE_INDEX_i_(b)_STORING_(a,_c),_FAMILY_(a),_FAMILY_(b),_FAMILY_(c)

Parameters:

• attempt=1
• deadlock=true
• run=3
• shard=1

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/sql-queries

This test on roachdash | Improve this report!

Jira issue: CRDB-37875

[rytaft]

Deadlock here:

goroutine 434152 [runnable]:
github.com/sasha-s/go-deadlock.(*lockOrder).preLock(0x9d9af10, {0xc00ddc3a00, 0x5, 0x32}, {0x4bccaa0, 0xc0082ae0f8})
	github.com/sasha-s/go-deadlock/external/com_github_sasha_s_go_deadlock/deadlock.go:281 +0x10a
github.com/sasha-s/go-deadlock.preLock(...)
	github.com/sasha-s/go-deadlock/external/com_github_sasha_s_go_deadlock/deadlock.go:159
github.com/sasha-s/go-deadlock.lock(0xc005744e38, {0x4bccaa0, 0xc0082ae0f8})
	github.com/sasha-s/go-deadlock/external/com_github_sasha_s_go_deadlock/deadlock.go:176 +0x77
github.com/sasha-s/go-deadlock.(*Mutex).Lock(...)
	github.com/sasha-s/go-deadlock/external/com_github_sasha_s_go_deadlock/deadlock.go:85
github.com/cockroachdb/cockroach/pkg/server/settingswatcher.(*SettingsWatcher).GetStorageClusterActiveVersion(0xc0082ae000)
	github.com/cockroachdb/cockroach/pkg/server/settingswatcher/settings_watcher.go:583 +0x75
github.com/cockroachdb/cockroach/pkg/server.(*SQLServer).startTenantAutoUpgradeLoop.func1({0x67d5838, 0xc00ee1cff0})
	github.com/cockroachdb/cockroach/pkg/server/tenant_auto_upgrade.go:45 +0x125
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:485 +0x13a
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 317350
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:476 +0x3fe

[rytaft]

Dup of #122512