Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x/build: migrate over to the upgraded cluster at MacStadium #45088

Closed
11 tasks done
cagedmantis opened this issue Mar 17, 2021 · 4 comments
Closed
11 tasks done

x/build: migrate over to the upgraded cluster at MacStadium #45088

cagedmantis opened this issue Mar 17, 2021 · 4 comments
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Projects
Go Release Team
Milestone
Unreleased

Comments

@cagedmantis
Copy link
Contributor

cagedmantis commented Mar 17, 2021 •
edited

In order to continue supporting the darwin platform we've had to upgrade to a new MacStadium infrastructure. The latest versions of macOS would not be supported by the physical infrastructure of the hold cluster. These are the steps required to migrate over to a new cluster:

  • Research the current macOS build infrastructure.
  • Create a specification for what hardware was required for the new cluster to function properly and into the future. x/build: upgrade Mac Mini hardware versions hosted at MacStadium #40761 x/build: upgrade VMware ESXi in order to enable macOS 11.0 VMs #40757
  • Configure the network and firewall for the new cluster.
  • Migrate the bastion host to the new cluster and configure it.
  • Create storage volumes attached to specific hosts.
  • Migrate all of the virtual machine images from the old storage array to the new storage array.
  • Update makemac to support the new array and the new versioning scheme used by macOS.
  • Update the buildlet application to support the new versioning scheme used by macOS.
  • Open port 8713 for the bastion host on the firewall.
  • Update dns address for macstadiumd.golang.org.
  • Update infrastructure documentation.

@golang/release
@cagedmantis cagedmantis added Builders x/build issues (builders, bots, dashboards) NeedsFix The path to resolution is known, but the work has not been done. labels Mar 17, 2021
@cagedmantis cagedmantis added this to the Unreleased milestone Mar 17, 2021
@cagedmantis cagedmantis self-assigned this Mar 17, 2021
@cagedmantis cagedmantis added this to In Progress in Go Release Team Mar 17, 2021
@gopherbot
Copy link
Contributor

Change https://golang.org/cl/293829 mentions this issue: cmd/buildlet: add support for new macOS versioning

gopherbot pushed a commit to golang/build that referenced this issue Apr 6, 2021
@cagedmantis
cmd/buildlet: add support for new macOS versioning
a286c0a 
With the release of macOS 11.0 (Big Sur), the hostname for hosts need
to accomodate multiple architectures. The operating system version is
now noted in the major portion instead of the minor portion of the
version. This change creates the appropriate hostname in the buildlet.

Updates golang/go#40762
Updates golang/go#45088

Change-Id: I943f0c481442a892bb5793283c527b8400a5be9c
Reviewed-on: https://go-review.googlesource.com/c/build/+/293829
Trust: Carlos Amedee <carlos@golang.org>
Run-TryBot: Carlos Amedee <carlos@golang.org>
TryBot-Result: Go Bot <gobot@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>
@gopherbot
Copy link
Contributor

Change https://golang.org/cl/307731 mentions this issue: cmd/coordinator: update the count for amd64 Mac Hosts

gopherbot pushed a commit to golang/build that referenced this issue Apr 6, 2021
@cagedmantis
cmd/coordinator: update the count for amd64 Mac Hosts
741e4d9 
This change updates the number of Mac hosts that are expected to
connect to the coordinator. There is now a distinction between there
being a amd64 and arm64 Mac hosts. We have reduced the count of amd64
hosts to 8 and have been adding arm64 Macs.

Updates golang/go#45088

Change-Id: I97de966c8398ceb0e5cb31d6bbe688de69efc4a5
Reviewed-on: https://go-review.googlesource.com/c/build/+/307731
Trust: Carlos Amedee <carlos@golang.org>
Run-TryBot: Carlos Amedee <carlos@golang.org>
TryBot-Result: Go Bot <gobot@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>
@gopherbot
Copy link
Contributor

Change https://golang.org/cl/308489 mentions this issue: cmd/makemac: add changes to enable a migration to a new cluster

Go Release Team automation moved this from In Progress to Done Apr 8, 2021
@gopherbot
Copy link
Contributor

Change https://golang.org/cl/313710 mentions this issue: env/darwin/macstadium: update documentation after cluster migration

gopherbot pushed a commit to golang/build that referenced this issue Apr 28, 2021
@cagedmantis
env/darwin/macstadium: update documentation after cluster migration
7eefc07 
The macOS cluster hosted at MacStadium has been migrated to a new set
of machines. With that migration, several configuration options
changed along with the migration. This change updates the
documentation to reflect the changes which have been made.

For golang/go#45088

Change-Id: I076f482865f3a1ce57addd8495ab18588c2d87e2
Reviewed-on: https://go-review.googlesource.com/c/build/+/313710
Trust: Carlos Amedee <carlos@golang.org>
Run-TryBot: Carlos Amedee <carlos@golang.org>
TryBot-Result: Go Bot <gobot@golang.org>
Reviewed-by: Heschi Kreinick <heschi@google.com>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>
Reviewed-by: Alexander Rakoczy <alex@golang.org>
@cagedmantis cagedmantis mentioned this issue May 17, 2021
Closed
@golang golang locked and limited conversation to collaborators May 17, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done.
Projects
Go Release
Archived in project
Go Release Team
Done
Milestone
Unreleased
Development

No branches or pull requests
2 participants
@cagedmantis @gopherbot