Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Long simulation runs slow down as files accumulate in MCRUN folder #1

Open
imabug opened this issue Dec 1, 2022 · 1 comment
Open
Assignees
Labels
enhancement New feature or request

Comments

@imabug
Copy link
Owner

imabug commented Dec 1, 2022

Description

Long simulation runs can generate a lot of data files. This seems to cause delays at the file system level when lots of files accumulate in PCXMC's MCRUN folder, where the simulation results are saved.

Probably should build in a section where periodically, the result files are moved somewhere else (after the rotation loop perhaps) so that they can be collected and put into the database.

This would interfere with the way simulations are restarted after being interrupted, so that part would need to be re-done.

@imabug imabug added the enhancement New feature or request label Dec 1, 2022
@imabug imabug self-assigned this Dec 1, 2022
@imabug
Copy link
Owner Author

imabug commented Apr 14, 2023

I think this can be solved by storing the simulation results to the database as each run is completed. Then there's no need to write separate output files for each run. This wouldn't solve the problem of restarting an interrupted simulation run though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant