Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

write to tempfile on emr_track.var.set #110

Merged
merged 2 commits into from
Sep 10, 2023

Conversation

aviezerl
Copy link
Collaborator

@aviezerl aviezerl commented Sep 6, 2023

Fixes an error when multiple processes are calling emr_track.var.set on the same track.

Fixes an error when multiple processes are calling `emr_track.var.set` on the same track.
@aviezerl aviezerl force-pushed the fix@write-to-tempfile-on-emr_track.var.set branch from 3b3de6f to 1cfc87f Compare September 6, 2023 13:30
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How does this solve the problem? two procs can still try and call rename at the same time

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rename uses a system call (mv) which is atomic.

@aviezerl aviezerl merged commit 2963a5b into dev Sep 10, 2023
4 checks passed
@aviezerl aviezerl deleted the fix@write-to-tempfile-on-emr_track.var.set branch September 10, 2023 19:04
@aviezerl aviezerl restored the fix@write-to-tempfile-on-emr_track.var.set branch November 29, 2023 12:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants