Skip to content

x/build: drop Go branch prefix from presubmit LUCI builders for the main Go repository #66009

@mknyszek

Description

@mknyszek

Currently the LUCI builders all have a Go branch prefix. This makes the configuration simpler, and it makes the behavior of x/ repo builders against x/ repo changes explicit in the builder name.

This distinction is also necessary for displaying the Go repository postsubmit builders in the LUCI UI in a sensible way. If we were to drop the prefix and send all builds from all branches to the same Go repo builders in postsubmit, then the LUCI dashboard would display the latest build on any branch as the top-level status for a builder. This would make the overview of each dashboard at https://ci.chromium.org/p/golang very confusing. The LUCI UI generally treats distinct builders as having distinct histories, and we need to capture that distinction.

However, there are a few downsides, specifically for LUCI builders for the main Go repository in presubmit.

  • When the branch prefix is present in a commit message (via Cq-Include-Trybots) and the commit is cherry-picked to a release branch, the person performing the cherry-picking needs to be careful to update the Go branch in the commit message. If they do not, they will run into a failure to start trybots.
  • Because the filtering of the buildbucket Gerrit plugin is not very granular (on a bucket level only), this means the "Choose Tryjobs" dialog contains lots of builders that don't make sense for a particular change. For example, a Go repo change for the main branch should never run go1.21-* builders, yet they appear in the dialog as an option.

Note that dropping the prefix for presubmit makes sense while it doesn't for postsubmit, because presubmit builders don't really have a coherent notion of a history anyway.

I spent some time outlining how we might achieve this. Here are the steps:

  • Split out presubmit from the big config loop in main.star. (https://go.dev/cl/565420)
  • Split out the go project from the presubmit config loop from step (1).
  • Rework all properties dependent on the Go branch to be selectable at run-time via a map of branch to property value.
    • Today, this mercifully only applies to bootstrap_version.
  • Allow "" and None as Go branch values throughout main.star.
    • Builder names simply omit the branch and properties must not depend on the branch name. (Caveat: I don't know yet how to enforce that.)
  • Allow "" as a valid go_branch property value in golangbuild (with an attempt to infer from the input change). (https://chromium-review.googlesource.com/c/infra/infra/+/6188208)
    • This will require some refactoring in golangbuild, because installTools will need to know the version to index into the map.
  • Rework the go project presubmit config loop to generate one builder per builder type, passing a None and/or "" Go branch name.

An alternative implementation would be to create the notion of a "proxy" builder whose only job consists of forwarding its invocation to a more specific build. This is doable, but the "proxy" build would likely need to stay live through the execution of the builder(s) it invokes, which burns an additional machine for no reason.

Though, this choice may have other benefits. For example, we could use it to create builders that represents sets of other builders, for greater ease-of-use during presubmit.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Buildersx/build issues (builders, bots, dashboards)FrictionNuisances that make good candidates for our "friction" fix-it weeksNeedsFixThe path to resolution is known, but the work has not been done.

    Type

    No type

    Projects

    Status

    Planned

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions