Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallelize memory annotations #56

Closed
boomanaiden154 opened this issue Mar 4, 2024 · 1 comment
Closed

Parallelize memory annotations #56

boomanaiden154 opened this issue Mar 4, 2024 · 1 comment
Assignees
@boomanaiden154

Comments

@boomanaiden154
Copy link
Collaborator

The current script in ./gematria/datasets/convert_bhive_to_exegesis_inputs.cc runs sequentially. This is somewhat of a problem for using the Exegesis annotator, which isn't particularly fast. This can easily be parallelized as we don't care about the timings at all while running the annotations. This should be doable with some refactoring and use of LLVM's threading APIs.
@boomanaiden154 boomanaiden154 self-assigned this Mar 4, 2024
@boomanaiden154 boomanaiden154 mentioned this issue Mar 24, 2024
Closed
@boomanaiden154 boomanaiden154 linked a pull request Mar 24, 2024 that will close this issue
Parallelize memory annotations #83
Closed
@boomanaiden154
Copy link
Collaborator Author

Not planning on doing this within the process itself as doing it out of process with ray seems to work much better.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@boomanaiden154 boomanaiden154

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Parallelize memory annotations google/gematria
1 participant
@boomanaiden154