-
Notifications
You must be signed in to change notification settings - Fork 11.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CAS] LLVMCAS implementation #68448
Open
cachemeifyoucan
wants to merge
9
commits into
llvm:main
Choose a base branch
from
cachemeifyoucan:llvm-cas-implementation
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
[CAS] LLVMCAS implementation #68448
cachemeifyoucan
wants to merge
9
commits into
llvm:main
from
cachemeifyoucan:llvm-cas-implementation
Commits on Oct 9, 2023
-
Implement TrieRawHashMap which stores objects into a Trie based on the hash of the object. User needs to supply the hashing function and guarantees the uniqueness of the hash for the objects to be inserted. Hash collision is not supported
Configuration menu - View commit details
-
Copy full SHA for c3ce218 - Browse repository at this point
Copy the full SHA c3ce218View commit details -
[CAS] Add LLVMCAS library with InMemoryCAS implementation
Add llvm::cas::ObjectStore abstraction and InMemoryCAS as a in-memory CAS object store implementation. The ObjectStore models its objects as: * Content: An array of bytes for the data to be stored. * Refs: An array of references to other objects in the ObjectStore. And each CAS Object can be idenfied with an unqine ID/Hash. ObjectStore supports following general action: * Expected<ID> store(Content, ArrayRef<Ref>) * Expected<Ref> get(ID) It also introduces following types to interact with a CAS ObjectStore: * CASID: Hash representation for an CAS Objects with its context to help print/compare CASIDs. * ObjectRef: A light-weight ref for an object in the ObjectStore. It is implementation defined so it can be optimized for read/store/references depending on the implementation. * ObjectHandle: A CAS internal light-weight handle to an loaded object in the ObjectStore. Underlying data for the object is guaranteed to be available and no error handling is required to access data. This is not exposed to the users of CAS from ObjectStore APIs. * ObjectProxy: A proxy for the users of CAS to interact with the data inside CAS Object. It bundles a ObjectHandle and an ObjectStore instance. Differential Revision: https://reviews.llvm.org/D133716
Configuration menu - View commit details
-
Copy full SHA for 3166cc0 - Browse repository at this point
Copy the full SHA 3166cc0View commit details -
[FileSystem] Allow exclusive file lock
Add parameter to file lock API to allow exclusive file lock. Both Unix and Windows support lock the file exclusively for write for one process and LLVM OnDiskCAS uses exclusive file lock to coordinate CAS creation.
Configuration menu - View commit details
-
Copy full SHA for 6c7d348 - Browse repository at this point
Copy the full SHA 6c7d348View commit details
Commits on Oct 13, 2023
-
[CAS] Add implementation for current OnDisk CAS + abstractions
Add current downstream cas API and implementation that includes OnDiskCAS implementation, different level of abstractions for CAS, different utilities.
Configuration menu - View commit details
-
Copy full SHA for dbb48a0 - Browse repository at this point
Copy the full SHA dbb48a0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8c58a0f - Browse repository at this point
Copy the full SHA 8c58a0fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 34cbc76 - Browse repository at this point
Copy the full SHA 34cbc76View commit details -
[CAS] Add support for PluginCAS
Allow loading external CAS implementation via PluginCAS. In this patch, it adds: * C APIs that can be implemented by plugin, from which LLVM can load the dylib to use external CAS implementation * A PluginCAS, that implements vending external CAS implementation as llvm ObjectStore and ActionCache class. * A libCASPluginTest dylib, that provides example external CAS implementation that wraps LLVM CAS for testing purpose. * Add a unified way to load external CAS implementation.
Configuration menu - View commit details
-
Copy full SHA for 8442410 - Browse repository at this point
Copy the full SHA 8442410View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1cbcebd - Browse repository at this point
Copy the full SHA 1cbcebdView commit details
Commits on Oct 16, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 281d178 - Browse repository at this point
Copy the full SHA 281d178View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.