Skip to content

Conversation

@iliana
Copy link
Contributor

@iliana iliana commented Jul 16, 2023

  1. Moving the zones onto the U.2 devices ([sled agent] Store zone filesystems on U.2s, not the ramdisk #3557), real or synthetic, results in the paths of all the zones changing, which results in the paths of all their logs changing. Updated the deploy.sh job to look in the new spot for logs, so that we can find:
  2. The end-to-end test is failing1 because Nexus is returning a 500 on disk creation, because Nexus cannot contact the Crucible downstairs, because the Crucible agent is repeatedly panicking because it cannot create a dataset, because the zpool is out of space. We attempt to rectify the issue by increasing the size of the synthetic drives in create_virtual_hardware.sh.
  3. It is possible that we are hitting this limit for the first time because Crucible as of Update Crucible and Propolis to latest #3646 reserves more space.

(We should also switch the deploy job to using real disks, instead of tmpfs, for these datasets. But that will not be part of this PR.)

Footnotes

  1. Not always; some commits are evidently lucky.

@iliana iliana merged commit 344773a into main Jul 16, 2023
@iliana iliana deleted the iliana/job-glob branch July 16, 2023 08:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants