Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: backup-restore/mixed-version failed #122754

Closed
cockroach-teamcity opened this issue Apr 20, 2024 · 2 comments
Closed

roachtest: backup-restore/mixed-version failed #122754

cockroach-teamcity opened this issue Apr 20, 2024 · 2 comments
Assignees
@msbutler
Labels
branch-master Failures on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. P-1 Issues/test failures with a fix SLA of 1 month release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery
Projects
Disaster Recovery Backlog
Milestone
24.1

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Apr 20, 2024 •
edited by cockroach-jira-scripts
Loading

roachtest.backup-restore/mixed-version failed with artifacts on master @ c4ab095c4f65b9140661ed57adddc690b1e3ce3f:

(mixedversion.go:592).Run: mixed-version test failure while running step 77 (run "verify all backups"): 2 errors during restore:
1: v23.2.4: backup 16_v23.2.4-to-master_all-planned-and-executed-on-master_cluster: mismatched fingerprints for table tpcc.order_line (artifacts collected in restore_failure_1)
2: master: backup 16_v23.2.4-to-master_all-planned-and-executed-on-master_cluster: mismatched fingerprints for table tpcc.order_line (artifacts collected in restore_failure_2)
test artifacts and logs in: /artifacts/backup-restore/mixed-version/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=true
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-38048
@cockroach-teamcity cockroach-teamcity added branch-master Failures on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery labels Apr 20, 2024
@cockroach-teamcity cockroach-teamcity added this to the 24.1 milestone Apr 20, 2024
@cockroach-teamcity cockroach-teamcity mentioned this issue Apr 22, 2024
Closed
@exalate-issue-sync exalate-issue-sync bot added the P-1 Issues/test failures with a fix SLA of 1 month label Apr 22, 2024
msbutler added a commit to msbutler/cockroach that referenced this issue Apr 22, 2024
@msbutler
backupccl: copy spans before SubtractSpans calls
b037095 
Previously, backup assumed arguments to roachpb.SubtractSpans could be used,
but the first arg is modified in place. This patch adds a wrapper to
roachpb.SubtractSpans to copy the input spans before use.

Informs cockroachdb#122672
Informs cockroachdb#122734
Informs cockroachdb#122754
Informs cockroachdb#122764

Release note: none
@msbutler msbutler mentioned this issue Apr 22, 2024
Merged
craig bot pushed a commit that referenced this issue Apr 22, 2024
@msbutler
Merge #122819
d679773 
122819: backupccl: copy spans before SubtractSpans calls r=dt a=msbutler

Previously, backup assumed arguments to roachpb.SubtractSpans could be used, but the first arg is modified in place. This patch adds a wrapper to roachpb.SubtractSpans to copy the input spans before use.

Informs #122672
Informs #122734
Informs #122754
Informs #122764

Release note: none

Co-authored-by: Michael Butler <butler@cockroachlabs.com>
blathers-crl bot pushed a commit that referenced this issue Apr 22, 2024
@msbutler
backupccl: copy spans before SubtractSpans calls
64504df 
Previously, backup assumed arguments to roachpb.SubtractSpans could be used,
but the first arg is modified in place. This patch adds a wrapper to
roachpb.SubtractSpans to copy the input spans before use.

Informs #122672
Informs #122734
Informs #122754
Informs #122764

Release note: none
@blathers-crl blathers-crl bot mentioned this issue Apr 22, 2024
Closed
@cockroach-teamcity
Copy link
Member Author

roachtest.backup-restore/mixed-version failed with artifacts on master @ e215cf435851cb9490fe4494fe73d02041c4d2c0:

(mixedversion.go:592).Run: mixed-version test failure while running step 8 (run "initialize tpcc workload"): full command output in run_081602.752508762_n5_cockroach-workload-i.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/backup-restore/mixed-version/run_1

Parameters:

  • ROACHTEST_arch=amd64
  • ROACHTEST_cloud=gce
  • ROACHTEST_coverageBuild=false
  • ROACHTEST_cpu=4
  • ROACHTEST_encrypted=false
  • ROACHTEST_fs=ext4
  • ROACHTEST_localSSD=true
  • ROACHTEST_metamorphicBuild=false
  • ROACHTEST_ssd=0
Help

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

This test on roachdash | Improve this report!

@msbutler
Copy link
Collaborator

fixed via #122819

Disaster Recovery Backlog automation moved this from Backlog to Done Apr 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@msbutler msbutler

Labels
branch-master Failures on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. P-1 Issues/test failures with a fix SLA of 1 month release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery
Projects
Disaster Recovery Backlog
Done
Milestone
24.1
Development

No branches or pull requests
2 participants
@cockroach-teamcity @msbutler