Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build: 11 of our 20 Macs are offline, VMware problems #27164

Closed
bradfitz opened this issue Aug 22, 2018 · 5 comments
Closed

x/build: 11 of our 20 Macs are offline, VMware problems #27164

bradfitz opened this issue Aug 22, 2018 · 5 comments
Assignees
Milestone

Comments

@bradfitz
Copy link
Contributor

@bradfitz bradfitz commented Aug 22, 2018

Our 10-node MacMini cluster VMware cluster is unhappy.

11 of our VMs are offline.

makemac keeps trying to get it back to 20 but is failing with:

Aug 22 16:22:43 godns makemac[1309]: 2018/08/22 16:22:43 Error creating 10.11: govc vm.create ...: exit status 1, govc: datastore 'BOOT_5' not found

/cc @dmitshur @andybons

@gopherbot gopherbot added this to the Unreleased milestone Aug 22, 2018
@gopherbot gopherbot added the Builders label Aug 22, 2018
@bradfitz

This comment has been minimized.

Copy link
Contributor Author

@bradfitz bradfitz commented Aug 23, 2018

vSphere crapped itself. MacStadium restarted something. I'll check on it more tomorrow.

@bradfitz

This comment has been minimized.

Copy link
Contributor Author

@bradfitz bradfitz commented Aug 23, 2018

MacStadium support says:

Hey Brad. We identified an issue with the host configurations that was causing the vCenter service to not start properly. We have remediated the issue and are rebooting the vCenter. It should be back up shortly. I will let you know when it is available again. Thanks.

@bradfitz

This comment has been minimized.

Copy link
Contributor Author

@bradfitz bradfitz commented Aug 23, 2018

(I can authenticate to the vCenter Flash UI now, but I get API errors and all Hosts & VMs are missing in inventory)

@bradfitz bradfitz self-assigned this Aug 24, 2018
@bradfitz bradfitz removed the Soon label Aug 24, 2018
@bradfitz

This comment has been minimized.

Copy link
Contributor Author

@bradfitz bradfitz commented Aug 24, 2018

Mostly fixed now (for this round). Few oddities remain.

@bradfitz

This comment has been minimized.

Copy link
Contributor Author

@bradfitz bradfitz commented Aug 29, 2018

All good.

@bradfitz bradfitz closed this Aug 29, 2018
@golang golang locked and limited conversation to collaborators Aug 29, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.