Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Blake3 hasher for computing the action message #395

Merged
merged 1 commit into from
Nov 19, 2023

Conversation

allada
Copy link
Member

@allada allada commented Nov 16, 2023

Migrate the internal hashing algorithm used to compute the hash for the action when sending to/from the worker/scheduler. This is a minor optimization to move away from Sha256.


This change is Reviewable

Copy link
Member Author

@allada allada left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+@blakehatch

Reviewable status: 0 of 4 files reviewed, all discussions resolved (waiting on @blakehatch)

Copy link
Member

@blakehatch blakehatch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 4 of 4 files at r1, all commit messages.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved (waiting on @allada)

Copy link
Member

@blakehatch blakehatch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: all files reviewed, 1 unresolved discussion (waiting on @allada)


cas/scheduler/action_messages.rs line 215 at r1 (raw file):

            execution_policy: None,     // Not used in the worker.
            results_cache_policy: None, // Not used in the worker.
            digest_function: digest_function::Value::Sha256.into(),

Change to Blake3

Copy link
Member Author

@allada allada left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewable status: all files reviewed, 1 unresolved discussion (waiting on @blakehatch)


cas/scheduler/action_messages.rs line 215 at r1 (raw file):

Previously, blakehatch (Blake Hatch) wrote…

Change to Blake3

This cannot be blake3 yet. This PR is only changing an internal hash that is nothing to do with the protocol. The next PR is going to change the protocol parts to use blake3.

allada added a commit that referenced this pull request Nov 17, 2023
Fully support Blake3 digest upload format. This can increase
performance significantly for cases where hashing files is a
bottleneck.

closes #395
allada added a commit that referenced this pull request Nov 17, 2023
Fully support Blake3 digest upload format. This can increase
performance significantly for cases where hashing files is a
bottleneck.

closes #395
@allada allada mentioned this pull request Nov 17, 2023
allada added a commit that referenced this pull request Nov 17, 2023
Fully support Blake3 digest upload format. This can increase
performance significantly for cases where hashing files is a
bottleneck.

closes #395
Migrate the internal hashing algorithm used to compute the hash
for the action when sending to/from the worker/scheduler. This
is a minor optimization to move away from Sha256.
@allada allada force-pushed the action-info-hash-to-use-blake3 branch from 95fff8f to ad04655 Compare November 18, 2023 23:05
Copy link
Member Author

@allada allada left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 2 of 4 files at r1, 2 of 2 files at r2, all commit messages.
Dismissed @blakehatch from a discussion.
Reviewable status: all files reviewed, 1 unresolved discussion (waiting on @blakehatch)

@allada allada merged commit 9543964 into main Nov 19, 2023
15 checks passed
@allada allada deleted the action-info-hash-to-use-blake3 branch November 19, 2023 00:06
allada added a commit that referenced this pull request Nov 20, 2023
Fully support Blake3 digest upload format. This can increase
performance significantly for cases where hashing files is a
bottleneck.

closes #395
allada added a commit that referenced this pull request Nov 20, 2023
Fully support Blake3 digest upload format. This can increase
performance significantly for cases where hashing files is a
bottleneck.

closes #395
allada added a commit that referenced this pull request Nov 20, 2023
Fully support Blake3 digest upload format. This can increase
performance significantly for cases where hashing files is a
bottleneck.

closes #395
TripleKai pushed a commit to TripleKai/turbo-cache that referenced this pull request Nov 29, 2023
Migrate the internal hashing algorithm used to compute the hash
for the action when sending to/from the worker/scheduler. This
is a minor optimization to move away from Sha256.
TripleKai pushed a commit to TripleKai/turbo-cache that referenced this pull request Nov 29, 2023
Fully support Blake3 digest upload format. This can increase
performance significantly for cases where hashing files is a
bottleneck.

closes TraceMachina#395
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants