Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IPython.parallel tests seem to hang on ShiningPanda #3210

Closed
takluyver opened this issue Apr 23, 2013 · 2 comments · Fixed by #4270
Closed

IPython.parallel tests seem to hang on ShiningPanda #3210

takluyver opened this issue Apr 23, 2013 · 2 comments · Fixed by #4270
Assignees
Labels
Milestone

Comments

@takluyver
Copy link
Member

I've bumped the time limit up to 25 minutes, but it still gets cut off before the parallel tests complete, and the progress indicator isn't any further along than it was with the 15-minute cut off. See this log.

On my system, the IPython.parallel suite completes in 90 seconds (195 tests, no skips), so I think something is getting stuck.

For now, I've disabled the parallel tests (removed the --all flag) so that we can use the rest of the test suite.

@ghost ghost assigned minrk Apr 23, 2013
@takluyver
Copy link
Member Author

The Windows tests appear to have had the same problem, and it waited 2 hours before aborting the build. Also disabled parallel tests there.

@takluyver
Copy link
Member Author

@minrk I'm still seeing this on Linux on ShiningPanda (timeout after 25 minutes), although it seems to be fixed on Windows. I've had to disable --all again.

It's extra annoying, because we don't get failure e-mails for builds that are aborted due to a timeout, so it fails silently.

minrk added a commit that referenced this issue Sep 27, 2013
adjust Scheduler timeout logic

Timeout starts when task submission is attempted. That is, it starts each time in resubmit / retry cases.

Avoids issues of timeout firing only once while a task is pending, when it might come back and be retried after the timeout has fired.

Also adds a ten second timeout for sync calls in the tests, which should hopefully avoid hangs when things are misbehaving.

closes #3210
mattvonrocketstein pushed a commit to mattvonrocketstein/ipython that referenced this issue Nov 3, 2014
adjust Scheduler timeout logic

Timeout starts when task submission is attempted. That is, it starts each time in resubmit / retry cases.

Avoids issues of timeout firing only once while a task is pending, when it might come back and be retried after the timeout has fired.

Also adds a ten second timeout for sync calls in the tests, which should hopefully avoid hangs when things are misbehaving.

closes ipython#3210
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants