Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CCAPS IO - slow python startup times are a bottle neck #103

Open
JOThurgood opened this issue Jan 23, 2019 · 1 comment
Open

CCAPS IO - slow python startup times are a bottle neck #103

JOThurgood opened this issue Jan 23, 2019 · 1 comment
Labels
enhancement New feature or request

Comments

@JOThurgood
Copy link
Owner

JOThurgood commented Jan 23, 2019

IO currently outputs simple .dat files and immediately calls a python script to plot them. This can lead to many calls to python (once for each dump). The python plotting script is substantially slower than the rest of the code.

Ideally

  • output sequentially numbered dat files at each dump
  • create a single post-processing script to do the simple visualisations at the end (or, perhaps at the start and have it wait on new dump files) to avoid multiple startup and exits of python
  • this also has benefit of paving the way towards keeping dat files for more complicated post-processing / analysis
@JOThurgood
Copy link
Owner Author

Not just start up times bottlenecking - once getting to about 512x512 a lot of the plots take very long to do and the python script seems to hog a lot of memory (much than the simulation itself) during the process.

@JOThurgood JOThurgood added the enhancement New feature or request label Mar 12, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant