Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build/env/linux-ppc64: update ppc64 and ppc64le from Debian jessie #34830

Closed
bradfitz opened this issue Oct 10, 2019 · 8 comments
Closed

x/build/env/linux-ppc64: update ppc64 and ppc64le from Debian jessie #34830

bradfitz opened this issue Oct 10, 2019 · 8 comments

Comments

@bradfitz
Copy link
Contributor

@bradfitz bradfitz commented Oct 10, 2019

The OSUOSL ppc64 and ppc64le buildlet images are old:

  • The use Debian Jessie. Upgrade them to Stretch, then to Buster.
  • ~~They don't use x/build/cmd/rundockerbuildlet, no builds & gomote users can permanently break the host during a session. ~~ (oh, that is #21189)
@gopherbot gopherbot added this to the Unreleased milestone Oct 10, 2019
@bradfitz
Copy link
Contributor Author

@bradfitz bradfitz commented Oct 10, 2019

Meta bug about cleaning up buildlets is #21260

@bradfitz bradfitz changed the title x/bulid/env/linux-ppc64: update ppc64 and ppc64le buildlets to buster, rundockerbuildlet x/build/env/linux-ppc64: update ppc64 and ppc64le buildlets to buster, rundockerbuildlet Oct 10, 2019
@bradfitz bradfitz closed this Oct 10, 2019
@bradfitz bradfitz changed the title x/build/env/linux-ppc64: update ppc64 and ppc64le buildlets to buster, rundockerbuildlet x/build/env/linux-ppc64: update ppc64 and ppc64le buildlets to buster Oct 10, 2019
@bradfitz bradfitz reopened this Oct 10, 2019
@bradfitz
Copy link
Contributor Author

@bradfitz bradfitz commented Oct 10, 2019

go-le-5 is updated from jessie to stretch to buster as a test.

Before:
Linux go-le-5 3.16.0-4-powerpc64le #1 SMP Debian 3.16.7-ckt25-1 (2016-03-06) ppc64le GNU/Linux

After:
Linux go-le-5 4.19.0-6-powerpc64le #1 SMP Debian 4.19.67-2 (2019-08-28) ppc64le GNU/Linux

/cc @laboger @ceseo

@gopherbot
Copy link

@gopherbot gopherbot commented Oct 11, 2019

Change https://golang.org/cl/200757 mentions this issue: env/linux-ppc64le/osuosl: update NOTES

gopherbot pushed a commit to golang/build that referenced this issue Oct 11, 2019
One of the little ppc64le VMs was lost in the upgrade, and we got one
new beefy one.

Updates golang/go#34830
Updates golang/go#21189
Updates golang/go#21260

Change-Id: I4488d106c5c146c6e55d2d3528913f5507b9d57b
Reviewed-on: https://go-review.googlesource.com/c/build/+/200757
Reviewed-by: Bryan C. Mills <bcmills@google.com>
@gopherbot
Copy link

@gopherbot gopherbot commented Oct 11, 2019

Change https://golang.org/cl/200820 mentions this issue: env/linux-ppc64{,le}/osuosl: update NOTES

gopherbot pushed a commit to golang/build that referenced this issue Oct 15, 2019
Add details of 3 new big VMs: POWER8 (le), POWER9 (le), and POWER8 (be).

Still not configured, but we have them provisioned.

Updates golang/go#34830
Updates golang/go#21189
Updates golang/go#21260

Change-Id: If648e9966485062cda8131caf2ac5f87ab839fc5
Reviewed-on: https://go-review.googlesource.com/c/build/+/200820
Reviewed-by: Bryan C. Mills <bcmills@google.com>
@gopherbot
Copy link

@gopherbot gopherbot commented Oct 17, 2019

Change https://golang.org/cl/201637 mentions this issue: all: update linux-ppc64le builders

@bradfitz bradfitz changed the title x/build/env/linux-ppc64: update ppc64 and ppc64le buildlets to buster x/build/env/linux-ppc64le: update buildlets to buster Oct 17, 2019
@bradfitz bradfitz changed the title x/build/env/linux-ppc64le: update buildlets to buster x/build/env/linux-ppc64: update ppc64 and ppc64le from Debian jessie Oct 17, 2019
@bradfitz
Copy link
Contributor Author

@bradfitz bradfitz commented Oct 17, 2019

We're now using rundockerbuildlet for ppc64le (both POWER8 and POWER9), but Docker isn't available for ppc64 (big endian) so we'll need to do something else.

Perhaps just chroots into per-build overlayfs mounts with a writable tmpfs overlaying a read-only host root. Mini trashy Docker.

gopherbot pushed a commit to golang/build that referenced this issue Oct 17, 2019
Fixes golang/go#21189
Updates golang/go#21260
Updates golang/go#34830 (ppc64 big endian remains)

Change-Id: I7ff38edb519bf4f34cd05bb795b6a41f72b10640
Reviewed-on: https://go-review.googlesource.com/c/build/+/201637
Reviewed-by: Carlos Eduardo Seo <cseo@linux.vnet.ibm.com>
Reviewed-by: Bryan C. Mills <bcmills@google.com>
@gopherbot
Copy link

@gopherbot gopherbot commented Oct 28, 2019

Change https://golang.org/cl/203886 mentions this issue: env/linux-ppc64/osuosl: add Docker setup notes

@gopherbot gopherbot closed this in b1a7aa2 Nov 4, 2019
@gopherbot
Copy link

@gopherbot gopherbot commented Nov 5, 2019

Change https://golang.org/cl/205459 mentions this issue: env/linux-ppc64/osuosl: remove old VMs from notes

gopherbot pushed a commit to golang/build that referenced this issue Nov 5, 2019
They've been returned to OSU OSL.

Updates golang/go#34830

Change-Id: Id9de0d5d819e20456312fdb5817c82d1da6f845c
Reviewed-on: https://go-review.googlesource.com/c/build/+/205459
Reviewed-by: Bryan C. Mills <bcmills@google.com>
codebien added a commit to codebien/build that referenced this issue Nov 13, 2019
One of the little ppc64le VMs was lost in the upgrade, and we got one
new beefy one.

Updates golang/go#34830
Updates golang/go#21189
Updates golang/go#21260

Change-Id: I4488d106c5c146c6e55d2d3528913f5507b9d57b
Reviewed-on: https://go-review.googlesource.com/c/build/+/200757
Reviewed-by: Bryan C. Mills <bcmills@google.com>
codebien added a commit to codebien/build that referenced this issue Nov 13, 2019
Add details of 3 new big VMs: POWER8 (le), POWER9 (le), and POWER8 (be).

Still not configured, but we have them provisioned.

Updates golang/go#34830
Updates golang/go#21189
Updates golang/go#21260

Change-Id: If648e9966485062cda8131caf2ac5f87ab839fc5
Reviewed-on: https://go-review.googlesource.com/c/build/+/200820
Reviewed-by: Bryan C. Mills <bcmills@google.com>
codebien added a commit to codebien/build that referenced this issue Nov 13, 2019
Fixes golang/go#21189
Updates golang/go#21260
Updates golang/go#34830 (ppc64 big endian remains)

Change-Id: I7ff38edb519bf4f34cd05bb795b6a41f72b10640
Reviewed-on: https://go-review.googlesource.com/c/build/+/201637
Reviewed-by: Carlos Eduardo Seo <cseo@linux.vnet.ibm.com>
Reviewed-by: Bryan C. Mills <bcmills@google.com>
codebien added a commit to codebien/build that referenced this issue Nov 13, 2019
Collaboration with @tiborvass at Docker who got Docker running on
big-endian PPC64. Go for ppc64 doesn't support cgo or external
linking, so runc doesn't work, but a new OCI-compliant runc
implementation written in C (https://github.com/containers/crun) means
we can run Docker after all. See NOTES & build-*.sh

Then add a Dockerfile & associated cleanup in buildlet & stage0 to use
rundockerbuildlet.

Once done, might help with golang/go#35188, golang/go#32613, etc.

Fixes golang/go#34830
Updates golang/go#21260

Change-Id: I43d7afa1d58bbdfa16e3c57670bc41f1d1932d80
Reviewed-on: https://go-review.googlesource.com/c/build/+/203886
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
codebien added a commit to codebien/build that referenced this issue Nov 13, 2019
They've been returned to OSU OSL.

Updates golang/go#34830

Change-Id: Id9de0d5d819e20456312fdb5817c82d1da6f845c
Reviewed-on: https://go-review.googlesource.com/c/build/+/205459
Reviewed-by: Bryan C. Mills <bcmills@google.com>
@golang golang locked and limited conversation to collaborators Nov 4, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants