Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More issues with multiprocessing queue shutdown #14

Open
gatoatigrado opened this issue Dec 2, 2013 · 1 comment
Open

More issues with multiprocessing queue shutdown #14

gatoatigrado opened this issue Dec 2, 2013 · 1 comment

Comments

@gatoatigrado
Copy link
Owner

The closes_fds_test sometimes flakes. From some real-world testing, this isn't just a test flake, it's a real problem. I added some verbosity [ http://pastebin.com/eDvF1Gm0 ], and then added a loop that checked that the pipes the queue class uses were actually closed [ http://pastebin.com/Yx5qpf3C ]. The loop freezes when checking that the output queue's write pipe is closed.

Fortunately, one can call close() manually on pipe objects, and doing this seems to fix the flakiness. It's ugly, though, and I'm creating this issue so we can track it & reference why there's some ugly-looking code.

@gatoatigrado
Copy link
Owner Author

I have a work-around which I'm going to put up a review for now, but for further investigation it looks like the writer pipe should be closed here [ link ], but there are a number of exit paths which don't run that close method.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant