Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Workaround race condition with apt #3309

Merged
merged 1 commit into from Sep 19, 2018

Conversation

seibert
Copy link
Contributor

@seibert seibert commented Sep 13, 2018

Something is temporarily holding the dpkg lock on the Azure VMs when they first start up. This prevents the linux 32 config from apt-get installing something, but only some of the time. Adding a delay to hopefully avoid the conflict.

@seibert seibert mentioned this pull request Sep 14, 2018
@seibert
Copy link
Contributor Author

seibert commented Sep 14, 2018

Pinging @chrisrpatterson: I'm not sure what is holding the Debian package lock when the Ubuntu 16.04 VM boots up, but I find that inserting a sleep 10 into a task is required to reliably be able to apt-get install some packages.

@seibert
Copy link
Contributor Author

seibert commented Sep 14, 2018

My speculation based on googling for similar issues is that some auto-updater in Ubuntu is enabled, and it tries to refresh the package index when the VM starts up.

@chrispat
Copy link

@seibert yes we found a systemd unit that was running as soon as the network came up that was updating the apt cache. Due to the way we pool machines some sit for longer before they take a job and that is why you see the intermittent failure. We are working on a fix, thanks for the pointer to help narrow this down.

@seibert seibert changed the title Workaround mysterious race condition with apt Workaround race condition with apt Sep 14, 2018
@seibert
Copy link
Contributor Author

seibert commented Sep 14, 2018

Great! Glad you were able to figure out the issue.

@seibert seibert added this to In Progress in Heisenbugs Sep 14, 2018
@stuartarchibald
Copy link
Contributor

Thanks for the patch, seems to mitigate the issue noted. Merging.

@stuartarchibald stuartarchibald merged commit 808a2ee into numba:master Sep 19, 2018
@seibert seibert moved this from In Progress to Done in Heisenbugs Dec 11, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants