Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add RBE support for generated unresolved symlinks #15781

Closed
wants to merge 1 commit into from

Conversation

fmeum
Copy link
Collaborator

@fmeum fmeum commented Jun 30, 2022

Also adds support for such symlinks to the remote worker implementation.

Work towards #10298

@fmeum
Copy link
Collaborator Author

fmeum commented Jun 30, 2022

@coeuvre Can you review this PR?

This takes care of 1. in #15454 (comment) for generated symlinks.

Supporting source symlinks would require additional, possibly backwards incompatible changes. Since these are actually quite important for the new rules_js approach to NPM builds, I would be interested in tackling this aspect of RBE symlink. @lfpino Have you perhaps already thought about the source symlink case?

@fmeum fmeum marked this pull request as ready for review June 30, 2022 22:03
@fmeum fmeum requested a review from a team as a code owner June 30, 2022 22:03
// for non-normalized symlink targets, but the normalization applied by PathFragment.create
// does not take directory symlinks into account. However, Bazel's file system API does not
// currently offer a way to specify a raw String as a symlink target.
dst.createSymbolicLink(PathFragment.create(symlink.getTarget()));
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This can be fixed after #15773.

@sgowroji sgowroji added team-Remote-Exec Issues and PRs for the Execution (Remote) team awaiting-review PR is awaiting review from an assigned reviewer labels Jul 1, 2022
@fmeum
Copy link
Collaborator Author

fmeum commented Jul 12, 2022

@coeuvre Friendly ping

@bazaglia
Copy link

@coeuvre Many Node.js users are waiting for this for a long time to have RBE with rules_js. It would be nice to get it reviewed. 😄

@coeuvre
Copy link
Member

coeuvre commented Jul 21, 2022

Sure. I will definitely review it once I get the time.


bazel clean --expunge
bazel \
--windows_enable_symlinks \
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we check whether it is running on windows to conditionally add the flag --windows_enable_symlinks instead of running the build twice?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just added --windows_enable_symlinks to both builds - it is a no-op on non-Windows platforms and the difference between the two builds should only be --experimental_remote_merkle_tree_cache.

@coeuvre
Copy link
Member

coeuvre commented Aug 22, 2022

LGTM. Please rebase and update the test.

Also adds support for such symlinks to the remote worker implementation.
@ShreeM01 ShreeM01 removed the awaiting-review PR is awaiting review from an assigned reviewer label Sep 15, 2022
@fmeum fmeum deleted the unresolved-symlinks-rbe branch October 6, 2022 18:18
aiuto pushed a commit to aiuto/bazel that referenced this pull request Oct 12, 2022
Also adds support for such symlinks to the remote worker implementation.

Work towards bazelbuild#10298

Closes bazelbuild#15781.

PiperOrigin-RevId: 469196671
Change-Id: I441da6d0a658d142153ada6cc0f836bf2ed3bcff
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
team-Remote-Exec Issues and PRs for the Execution (Remote) team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants