Conversation
|
@tylerjereddy One more request. Would you be willing to review this Change set. Primarily I would like feedback on my multiprocessing implementation. I've found that this drastically speeds up the parsing for large number file sets. |
tylerjereddy
left a comment
There was a problem hiding this comment.
I added some initial comments/thoughts, a lot of it related to testing robustness to be confident in the parallel behavior.
I didn't try to check if the new functionality is actually faster, the community like using https://github.com/airspeed-velocity/asv for that, although this is quite formal so may be too much if you already have the performance envidence you need.
|
Thanks for the feedback @tylerjereddy I've significantly updated the testing and opened a couple of follow on issues. |
This enables parallel file processing for outputs, tallies, and dumps but default.