Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.Sign up
x/build: Kubernetes-ify all misc build services & bots #18817
The Go build system & project bots are all ran in different ways & places.
This is a tracking bug to unify them to all run consistently on Kubernetes on GKE in our existing build project.
First CL was https://golang.org/cl/35810 to write a Dockerfile for the coordinator.
…te service Currently the Gerrit polling & git mirroring & serving & syncing functionality is in the "watcher" process, which is in the same binary as the cmd/coordinator (farmer.golang.org), but runs as a separate process on that machine, and actually run in a separate Docker container so it has a cache volume and the /usr/bin/git binary, etc. A flag determines where func main delegates to: the build coordinator, or the git mirror. Start cleaning this up, in prep to run on Kubernetes as a separate service. This copies the env/watcher-world/Dockerfile into a new gitmirror Dockerfile, and copies the existing cmd/coordinator/watcher_process.go into a new cmd/gitmirror/gitmirror.go process. None of this is deployed or working yet. Once it's running and happy, I'll then switch the coordinator to find & use it on GKE, and then delete the old code. Updates golang/go#18817 Change-Id: Ibaa87f244f08ce61662e689b815740c72c997536 Reviewed-on: https://go-review.googlesource.com/35911 Reviewed-by: Jaana Burcu Dogan <firstname.lastname@example.org>
So far gitmirror (internal) and https://pubsubhelper.golang.org/ are on GKE.
Before: REPOSITORY SIZE gcr.io/go-dashboard-dev/pubsubhelper 834MB After: REPOSITORY SIZE gcr.io/go-dashboard-dev/pubsubhelper 12.3MB Updates golang/go#18817 Change-Id: Ibf1f33a04043c0defddd7fe6b8d0455092044ac0 Reviewed-on: https://go-review.googlesource.com/40574 Reviewed-by: Kevin Burke <email@example.com>
Before: REPOSITORY SIZE gcr.io/go-dashboard-dev/coordinator 895MB After: REPOSITORY SIZE gcr.io/go-dashboard-dev/coordinator 20.5MB Updates golang/go#18817 Change-Id: I144923fcd85aab5f1aaaa3f012143bac45f5086b Reviewed-on: https://go-review.googlesource.com/40570 Reviewed-by: Kevin Burke <firstname.lastname@example.org>
Before: REPOSITORY SIZE gcr.io/go-dashboard-dev/gitmirror 1.32GB After: REPOSITORY SIZE gcr.io/go-dashboard-dev/gitmirror 208MB Updates golang/go#18817 Change-Id: I633fbbde2c5bba52535a8cfefdcb1f0532c45c06 Reviewed-on: https://go-review.googlesource.com/40571 Reviewed-by: Brad Fitzpatrick <email@example.com> Reviewed-by: Kevin Burke <firstname.lastname@example.org>
Before: REPOSITORY SIZE gcr.io/go-dashboard-dev/maintnerd 786MB After: REPOSITORY SIZE gcr.io/go-dashboard-dev/maintnerd 8.85MB Updates golang/go#18817 Updates golang/go#19866 Change-Id: Ibfdadbaf043e44b26d5807c1da45746e934a7dce Reviewed-on: https://go-review.googlesource.com/40572 Reviewed-by: Kevin Burke <email@example.com>
- buildongce is taught how to create the go cluster - config files for Docker services and pods - Dockerfile updated to fix caching Updates golang/go#18817 Change-Id: If25d41723996b92069117f4d75488202b63310ef Reviewed-on: https://go-review.googlesource.com/42231 Reviewed-by: Brad Fitzpatrick <firstname.lastname@example.org>
- Make URLs point to correct external IP - Disable windows-amd64-2008 builder type that doesn't exist in the staging farm Updates golang/go#18817 Change-Id: Id64a63694f90e70c4fd78f9d1433ed5031822111 Reviewed-on: https://go-review.googlesource.com/42850 Reviewed-by: Brad Fitzpatrick <email@example.com>