Skip to content

[9.1.0] Materialize important outputs from remote external repos (https://git…#28970

Merged
iancha1992 merged 2 commits intobazelbuild:release-9.1.0from
iancha1992:cp28442
Mar 27, 2026
Merged

[9.1.0] Materialize important outputs from remote external repos (https://git…#28970
iancha1992 merged 2 commits intobazelbuild:release-9.1.0from
iancha1992:cp28442

Conversation

@iancha1992
Copy link
Copy Markdown
Member

…hub.com//pull/28308)

Important outputs and runfiles from external repos that are remote repo contents cache hits got stuck at various levels of the materialization pipeline for being source artifacts. This is fixed by consolidating the skip logic in a RemoteOutputChecker static helper.

Closes #28308.

PiperOrigin-RevId: 881618604
Change-Id: Ifaae8e39b0bcab3803653ca82bcf00d26c487316

Description

Motivation

Build API Changes

No

Checklist

  • I have added tests for the new use cases (if any).
  • I have updated the documentation (if applicable).

Release Notes

RELNOTES: None

Commit 16613f1

@iancha1992 iancha1992 requested review from Wyverald and tjgq March 12, 2026 20:47
@iancha1992 iancha1992 requested a review from a team as a code owner March 12, 2026 20:47
@iancha1992 iancha1992 added team-Performance Issues for Performance teams team-ExternalDeps External dependency handling, remote repositiories, WORKSPACE file. team-Remote-Exec Issues and PRs for the Execution (Remote) team labels Mar 12, 2026
@github-actions github-actions bot added the awaiting-review PR is awaiting review from an assigned reviewer label Mar 12, 2026
@iancha1992 iancha1992 enabled auto-merge March 12, 2026 20:48
@iancha1992 iancha1992 removed request for Wyverald and tjgq March 12, 2026 20:58
@iancha1992 iancha1992 marked this pull request as draft March 12, 2026 20:59
auto-merge was automatically disabled March 12, 2026 20:59

Pull request was converted to draft

@iancha1992 iancha1992 closed this Mar 18, 2026
@github-actions github-actions bot removed the awaiting-review PR is awaiting review from an assigned reviewer label Mar 18, 2026
@iancha1992 iancha1992 reopened this Mar 18, 2026
@iancha1992 iancha1992 requested a review from tjgq March 18, 2026 21:19
@iancha1992 iancha1992 added the awaiting-review PR is awaiting review from an assigned reviewer label Mar 18, 2026
@iancha1992 iancha1992 marked this pull request as ready for review March 18, 2026 21:23
@iancha1992 iancha1992 enabled auto-merge March 18, 2026 21:23
@iancha1992 iancha1992 added this pull request to the merge queue Mar 24, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 24, 2026
@iancha1992 iancha1992 added this pull request to the merge queue Mar 25, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 25, 2026
@iancha1992 iancha1992 added this pull request to the merge queue Mar 25, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 25, 2026
@iancha1992 iancha1992 added this pull request to the merge queue Mar 25, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 25, 2026
@iancha1992 iancha1992 added this pull request to the merge queue Mar 25, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 25, 2026
@iancha1992 iancha1992 added this pull request to the merge queue Mar 25, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 25, 2026
@iancha1992 iancha1992 added this pull request to the merge queue Mar 26, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 26, 2026
@iancha1992 iancha1992 added this pull request to the merge queue Mar 26, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 26, 2026
@iancha1992 iancha1992 added this pull request to the merge queue Mar 26, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 26, 2026
@iancha1992
Copy link
Copy Markdown
Member Author

@Wyverald @tjgq The merge keeps getting cancelled so I am not able to merge this. Could you please take a look?

@Wyverald
Copy link
Copy Markdown
Member

that's weird indeed. I definitely don't think this PR specifically is to blame... although the failure is almost consistent at this point:

(06:57:38) ERROR: /Users/buildkite/builds/bk-macos-arm64-7zy8/bazel/bazel-bazel-github-presubmit/scripts/BUILD:9:8: Executing genrule //scripts:bash_completion failed: (Exit 1): bash failed: error executing Genrule command (from genrule rule target //scripts:bash_completion)
--
(cd /Users/buildkite/Library/Caches/bazel/_bazel_buildkite/68d94bab791abb705f6382b93049c21e/sandbox/darwin-sandbox/9731/execroot/_main && \
exec env - \
PATH=/bin:/usr/bin:/usr/local/bin \
/bin/bash -c 'source external/bazel_tools/tools/genrule/genrule-setup.sh;
TMPDIR=$(mktemp -d)
trap '\''rm -rf $TMPDIR'\'' EXIT
bazel-out/default_host_platform-opt-exec/bin/src/bazel --batch --output_user_root=$TMPDIR help completion bash > bazel-out/darwin_arm64-fastbuild/bin/scripts/bazel-complete.bash
')
# Configuration: 21635da9a90826e301194e74d72feac79f1a382759d7542acf587d7168d311b2
# Execution platform: //:default_host_platform
 
Use --sandbox_debug to see verbose messages from the sandbox and retain the sandbox build root for debugging
WARNING: Invoking Bazel in batch mode since it is not invoked from within a workspace (below a directory having a MODULE.bazel file).
Corrupt installation: file '/var/folders/4f/b9w38j2s03z2mm13c3z7z5_m0000gp/T/tmp.uYuGRSV0rX/install/A-server.jar' is missing or modified (this is expected if the installation is too old).
Removing previous installation at '/var/folders/4f/b9w38j2s03z2mm13c3z7z5_m0000gp/T/tmp.uYuGRSV0rX/install/' because it is corrupted or matches a different version
Extracting Bazel installation...
Error: Unable to access jarfile /var/folders/4f/b9w38j2s03z2mm13c3z7z5_m0000gp/T/tmp.uYuGRSV0rX/install/A-server.jar

@iancha1992 iancha1992 added this pull request to the merge queue Mar 26, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 26, 2026
@meteorcloudy meteorcloudy added this pull request to the merge queue Mar 27, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Mar 27, 2026
fmeum and others added 2 commits March 27, 2026 16:58
…28308)

Important outputs and runfiles from external repos that are remote repo contents cache hits got stuck at various levels of the materialization pipeline for being source artifacts. This is fixed by consolidating the skip logic in a `RemoteOutputChecker` static helper.

Closes bazelbuild#28308.

PiperOrigin-RevId: 881618604
Change-Id: Ifaae8e39b0bcab3803653ca82bcf00d26c487316
@iancha1992 iancha1992 added this pull request to the merge queue Mar 27, 2026
Merged via the queue into bazelbuild:release-9.1.0 with commit df1bd22 Mar 27, 2026
45 checks passed
@github-actions github-actions bot removed the awaiting-review PR is awaiting review from an assigned reviewer label Mar 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

team-ExternalDeps External dependency handling, remote repositiories, WORKSPACE file. team-Performance Issues for Performance teams team-Remote-Exec Issues and PRs for the Execution (Remote) team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants