Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor code to keep more things in memory #115

Open
hlasimpk opened this issue Aug 15, 2019 · 2 comments
Open

Refactor code to keep more things in memory #115

hlasimpk opened this issue Aug 15, 2019 · 2 comments
Assignees
@hlasimpk
Labels
enhancement

Comments

@hlasimpk
Copy link
Contributor

Some of the results are stored in temporary files - try and keep this in memory
@hlasimpk hlasimpk self-assigned this Aug 15, 2019
@fsimkovic
Copy link
Contributor

what are you aiming to get from this? reduce disk space or r/w overhead?

@hlasimpk
Copy link
Contributor Author

Reduce overhead - I think there are a few areas where I write everything to a file and then read out the results - especially moving between the rotation step and the MR step - but I'm not sure how feasible this is with clusters. Again, something to explore.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hlasimpk hlasimpk

Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@fsimkovic @hlasimpk