Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support --unix_digest_hash_attribute_name in repository cache #18221

Closed
wants to merge 12 commits into from

Conversation

sushain97
Copy link
Contributor

We extend RepositoryCache and DownloadManager to support pulling checksums from extended attributes. In some example builds, I observe a 5x speedup in repository fetching: https://github.com/sushain97/bazel-faster-fetch-repro.

I would like to make xattrProvider not-nullable in any context. However, it's not immediately clear how I could thread access to one in the BazelPackageLoader context: https://github.com/sushain97/bazel/blob/1518e04579e6a1c966eb8fbf6d65603e0a1d41d5/src/main/java/com/google/devtools/build/lib/skyframe/packages/BazelPackageLoader.java#L108-L110. Open to any suggestions.

@google-cla
Copy link

google-cla bot commented Apr 25, 2023

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

@github-actions github-actions bot added awaiting-review PR is awaiting review from an assigned reviewer team-ExternalDeps External dependency handling, remote repositiories, WORKSPACE file. labels Apr 25, 2023
@sushain97 sushain97 changed the title Support --unix_digest_hash_attribute_name in repository cache Support --unix_digest_hash_attribute_name in repository cache May 2, 2023
@Wyverald Wyverald added awaiting-PR-merge PR has been approved by a reviewer and is ready to be merge internally and removed awaiting-review PR is awaiting review from an assigned reviewer labels May 4, 2023
@sushain97
Copy link
Contributor Author

@coeuvre Thanks for that flag! Does this look better?

@sushain97 sushain97 requested a review from coeuvre May 5, 2023 00:04
Copy link
Member

@coeuvre coeuvre left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@copybara-service copybara-service bot closed this in 87d6e9a May 5, 2023
@Pavank1992 Pavank1992 removed the awaiting-PR-merge PR has been approved by a reviewer and is ready to be merge internally label May 5, 2023
fweikert pushed a commit to fweikert/bazel that referenced this pull request May 25, 2023
We extend `RepositoryCache` and `DownloadManager` to support pulling checksums from extended attributes. In some example builds, I observe a 5x speedup in repository fetching: https://github.com/sushain97/bazel-faster-fetch-repro.

I would like to make `xattrProvider` not-nullable in any context. However, it's not immediately clear how I could thread access to one in the `BazelPackageLoader` context: https://github.com/sushain97/bazel/blob/1518e04579e6a1c966eb8fbf6d65603e0a1d41d5/src/main/java/com/google/devtools/build/lib/skyframe/packages/BazelPackageLoader.java#L108-L110. Open to any suggestions.

Closes bazelbuild#18221.

PiperOrigin-RevId: 529730007
Change-Id: Ic06b4585988a6b5c09f61cee68daf1dcdf3e46fc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
team-ExternalDeps External dependency handling, remote repositiories, WORKSPACE file.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants