Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PrePARE hangs with Pool #395

Closed
doutriaux1 opened this issue Aug 9, 2018 · 3 comments
Closed

PrePARE hangs with Pool #395

doutriaux1 opened this issue Aug 9, 2018 · 3 comments
Assignees
Labels

Comments

@doutriaux1
Copy link
Collaborator

from @aradhakrishnanGFDL

I notice my PrePARE python session hanging (I think it is the Pool function) in several cases (surprisingly if the input file is in /home or local mount, it seems ok for the most part). We don't really do any multiprocessing with PrePARE yet, so I thought a default of 4 while pooling may have been the cause since I was operating on a single file? I set the -max-processes to "1" and it doesn't hang, but throws an error and aborts. The inline documentation says "-1" is also applicable for this, which is not true since it throws an error.

I am checking to see what the root cause might be (may be catch an exception during pooling?) and if changing to "1" temporarily will get us to finish our runs for now. 

@glevava I think you implemented the Pool section, do you mind taking a look?
@mauzey1 you can take a look if you want, but I think @glevava can point us in the right direction first.

@aradhakrishnanGFDL
Copy link

The best example to reproduce this issue is to use an input file that has wrong source_type.

e.g use source_type: "AGCM" (rather than AOGCM)

related issue: #396

@aradhakrishnanGFDL
Copy link

Latest conda nightly build has no hang ups. Looks okay so far..Thanks

@doutriaux1
Copy link
Collaborator Author

Thanks @aradhakrishnanGFDL closing for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants