Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: import/mixed-versions failed #84150

Closed
cockroach-teamcity opened this issue Jul 10, 2022 · 1 comment
Closed

roachtest: import/mixed-versions failed #84150

cockroach-teamcity opened this issue Jul 10, 2022 · 1 comment
Labels
branch-release-22.1 Used to mark release blockers and technical advisories for 22.1 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. T-server-and-security DB Server & Security
Milestone

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Jul 10, 2022

roachtest.import/mixed-versions failed with artifacts on release-22.1 @ 64d9c24214b7d6912ecc1a8c8ed93073134c860d:

The test failed on branch=release-22.1, cloud=gce:
test artifacts and logs in: /artifacts/import/mixed-versions/run_1
	cluster.go:1930,import.go:320,versionupgrade.go:178,import.go:345,import.go:363,test_runner.go:883: output in run_052426.594661664_n1_cockroach_workload_fixtures_import_tpcc: ././cockroach workload fixtures import tpcc --warehouses=100  returned: COMMAND_PROBLEM: exit status 1
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1964
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1928
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.successfulImportStep.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/import.go:320
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:178
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runImportMixedVersion
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/import.go:345
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerImportMixedVersion.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/import.go:363
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:883
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1581
		Wraps: (2) output in run_052426.594661664_n1_cockroach_workload_fixtures_import_tpcc
		Wraps: (3) ././cockroach workload fixtures import tpcc --warehouses=100  returned
		  | stderr:
		  | I220710 05:24:27.543108 1 ccl/workloadccl/fixture.go:318  [-] 1  starting import of 9 tables
		  | I220710 05:24:29.634838 47 ccl/workloadccl/fixture.go:483  [-] 2  imported 5.2 KiB in warehouse table (100 rows, 0 index entries, took 1.979275164s, 0.00 MiB/s)
		  | I220710 05:24:29.893807 48 ccl/workloadccl/fixture.go:483  [-] 3  imported 100 KiB in district table (1000 rows, 0 index entries, took 2.238322458s, 0.04 MiB/s)
		  | I220710 05:25:37.395821 67 ccl/workloadccl/fixture.go:483  [-] 4  imported 156 MiB in order table (3000000 rows, 3000000 index entries, took 1m9.740094337s, 2.24 MiB/s)
		  | I220710 05:26:09.348938 66 ccl/workloadccl/fixture.go:483  [-] 5  imported 218 MiB in history table (3000000 rows, 0 index entries, took 1m41.693445467s, 2.15 MiB/s)
		  | I220710 05:26:33.021742 49 ccl/workloadccl/fixture.go:483  [-] 6  imported 1.7 GiB in customer table (3000000 rows, 3000000 index entries, took 2m5.365607426s, 14.05 MiB/s)
		  | I220710 05:27:09.038166 70 ccl/workloadccl/fixture.go:483  [-] 7  imported 3.0 GiB in stock table (10000000 rows, 0 index entries, took 2m41.382390047s, 19.01 MiB/s)
		  | I220710 05:27:56.702978 71 ccl/workloadccl/fixture.go:483  [-] 8  imported 1.6 GiB in order_line table (30005985 rows, 0 index entries, took 3m29.047386917s, 8.07 MiB/s)
		  | Error: importing fixture: importing table item: pq: unable to dial n2: breaker open
		  |
		  | stdout:
		Wraps: (4) COMMAND_PROBLEM
		Wraps: (5) Node 1. Command with error:
		  | ``````
		  | ././cockroach workload fixtures import tpcc --warehouses=100
		  | ``````
		Wraps: (6) exit status 1
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError
Help

See: roachtest README

See: How To Investigate (internal)

/cc @cockroachdb/bulk-io

This test on roachdash | Improve this report!

Jira issue: CRDB-17493

@cockroach-teamcity cockroach-teamcity added branch-release-22.1 Used to mark release blockers and technical advisories for 22.1 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Jul 10, 2022
@cockroach-teamcity cockroach-teamcity added this to the 22.1 milestone Jul 10, 2022
@msbutler msbutler removed the release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. label Jul 11, 2022
@msbutler
Copy link
Collaborator

Removing this release blocker, as failure is independent of import code and relates to the cluster being unable to connect to node 2 after it starts up. Many other mixed version roachtests occasionally fail for this reason (e.g. #63954). This could relate to #44101.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
branch-release-22.1 Used to mark release blockers and technical advisories for 22.1 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. T-server-and-security DB Server & Security
Development

No branches or pull requests

3 participants