Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Is temporary directory needed for results of mapping partitions? #10

Closed
arenas-guerrero-julian opened this issue Feb 5, 2021 · 1 comment
Closed

Is temporary directory needed for results of mapping partitions? #10

arenas-guerrero-julian opened this issue Feb 5, 2021 · 1 comment
Assignees
@arenas-guerrero-julian
Labels
enhancement New feature or request

Comments

@arenas-guerrero-julian
Copy link
Member

arenas-guerrero-julian commented Feb 5, 2021 •
edited
Loading

Currently write the results of mapping partitions in independent files in a temporary directory. Once I generate all triples, I unify the files. This may make sense to not having problems writing to file with parallelization.

When parallelization is enables, check if this temporary directory is needed or we can write directly to the final file.
@arenas-guerrero-julian arenas-guerrero-julian self-assigned this Feb 5, 2021
@arenas-guerrero-julian arenas-guerrero-julian added the enhancement New feature or request label Feb 5, 2021
@arenas-guerrero-julian
Copy link
Member Author

Temporary file not needed. Triples are correctly written to the same file when parallelizing. Removed temporary dir feature.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@arenas-guerrero-julian arenas-guerrero-julian

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@arenas-guerrero-julian