roachtest: alterpk-bank failed

[cockroach-teamcity]

(roachtest).alterpk-bank failed on master@4702643dd0755a48365a115c970415fbb5023ad2:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/alterpk-bank/run_1
	cluster.go:2141,alterpk.go:31,alterpk.go:40,test_runner.go:755: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod start teamcity-2387928-1603433032-10-n4cpu4:1-3 returned: exit status 1
		(1) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod start teamcity-2387928-1603433032-10-n4cpu4:1-3 returned
		  | stderr:
		  |
		  | stdout:
		  | teamcity-2387928-1603433032-10-n4cpu4: starting nodes
		  | 0: ~ : exit status 255
		  | (1) attached stack trace
		  |   -- stack trace:
		  |   | github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.(*crdbInstallHelper).startNode
		  |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cockroach.go:351
		  |   | github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.Cockroach.Start.func1
		  |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cockroach.go:141
		  |   | github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.(*SyncedCluster).Parallel.func1.1
		  |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cluster_synced.go:1651
		  |   | runtime.goexit
		  |   | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		  | Wraps: (2) ~ 
		  |   | 		ulimit -c unlimited; mkdir -p ${HOME}/logs;
		  |   | 		echo ">>> roachprod start: $(date)" >> ${HOME}/logs/roachprod.log;
		  |   | 		ps axeww -o pid -o command >> ${HOME}/logs/roachprod.log;
		  |   | 		[ -x /usr/bin/lslocks ] && /usr/bin/lslocks >> ${HOME}/logs/roachprod.log; 
		  |   | 		export ROACHPROD=1;
		  |   | 		GOTRACEBACK=crash COCKROACH_SKIP_ENABLING_DIAGNOSTIC_REPORTING=1 COCKROACH_DEV_LICENSE=crl-0-EJL04ukFGAEiI0NvY2tyb2FjaCBMYWJzIC0gUHJvZHVjdGlvbiBUZXN0aW5n COCKROACH_BINARY=/home/agent/work/.go/src/github.com/cockroachdb/cockroach/cockroach.linux-2.6.32-gnu-amd64 COCKROACH_ENABLE_RPC_COMPRESSION=false \
		  |   | 		./cockroach start --background --insecure --store=path=/mnt/data1/cockroach --log-dir=${HOME}/logs --cache=25% --max-sql-memory=25% --port=26257 --http-port=26258 --locality=cloud=gce,region=us-central1,zone=us-central1-b --join=34.70.33.200:26257 --advertise-host=$(hostname -I | awk '{print $1}') >> ${HOME}/logs/cockroach.stdout.log \
		  |   | 		                 2>> ${HOME}/logs/cockroach.stderr.log \
		  |   | 			|| (x=$?; cat ${HOME}/logs/cockroach.stderr.log; exit $x)
		  |   | 
		  | Wraps: (3) exit status 255
		  | Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *exec.ExitError: 
		  | I201023 06:06:36.933805 1 (gostd) cluster_synced.go:1733  command failed
		Wraps: (2) exit status 1
		Error types: (1) *main.withCommandDetails (2) *exec.ExitError

More

Artifacts: /alterpk-bank

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[jordanlewis]

Infra flake - nodes couldn't connect to each other at startup.

teamcity-2387928-1603433032-10-n4cpu4-0003> W201023 06:06:38.920463 20 server/init.go:474 ⋮ [n?] outgoing join rpc to ‹×› unsuccessful: ‹×›