Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build: 11 of our 20 Macs are offline, VMware problems #27164

Closed
bradfitz opened this issue Aug 22, 2018 · 5 comments

Comments

Projects
None yet
2 participants
@bradfitz
Copy link
Member

commented Aug 22, 2018

Our 10-node MacMini cluster VMware cluster is unhappy.

11 of our VMs are offline.

makemac keeps trying to get it back to 20 but is failing with:

Aug 22 16:22:43 godns makemac[1309]: 2018/08/22 16:22:43 Error creating 10.11: govc vm.create ...: exit status 1, govc: datastore 'BOOT_5' not found

/cc @dmitshur @andybons

@gopherbot gopherbot added this to the Unreleased milestone Aug 22, 2018

@gopherbot gopherbot added the Builders label Aug 22, 2018

@bradfitz

This comment has been minimized.

Copy link
Member Author

commented Aug 23, 2018

vSphere crapped itself. MacStadium restarted something. I'll check on it more tomorrow.

@bradfitz

This comment has been minimized.

Copy link
Member Author

commented Aug 23, 2018

MacStadium support says:

Hey Brad. We identified an issue with the host configurations that was causing the vCenter service to not start properly. We have remediated the issue and are rebooting the vCenter. It should be back up shortly. I will let you know when it is available again. Thanks.

@bradfitz

This comment has been minimized.

Copy link
Member Author

commented Aug 23, 2018

(I can authenticate to the vCenter Flash UI now, but I get API errors and all Hosts & VMs are missing in inventory)

@bradfitz bradfitz self-assigned this Aug 24, 2018

@bradfitz bradfitz removed the Soon label Aug 24, 2018

@bradfitz

This comment has been minimized.

Copy link
Member Author

commented Aug 24, 2018

Mostly fixed now (for this round). Few oddities remain.

@bradfitz

This comment has been minimized.

Copy link
Member Author

commented Aug 29, 2018

All good.

@bradfitz bradfitz closed this Aug 29, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.