Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[tests][dask] Use workers hostname in tests (fixes #4594) #4595

Merged
merged 2 commits into from
Sep 9, 2021

Conversation

jmoralez
Copy link
Collaborator

@jmoralez jmoralez commented Sep 5, 2021

Fixes #4594.

Since the dask tests run on a LocalCluster we used 127.0.0.1 as the host for the workers, however something seems to have changed and on my machine (ubuntu) now the scheduler gets 127.0.0.1 and the workers get 192.168.100.4 and in the QEMU build they're getting 172.17.0.2. This PR extracts the hostname from the worker addresses to run the tests that require using the workers' addresses.

Copy link
Collaborator

@jameslamb jameslamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

excellent, thanks for the explanation and quick fix!

Copy link
Collaborator

@StrikerRUS StrikerRUS left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks a lot for the prompt fix!

@jameslamb jameslamb changed the title [tests][dask] Use workers hostname in tests [tests][dask] Use workers hostname in tests (fixes #4594) Sep 7, 2021
@StrikerRUS
Copy link
Collaborator

Closing-reopening because simple rerun doesn't help with QEMU timeout error.

@StrikerRUS StrikerRUS closed this Sep 7, 2021
@StrikerRUS StrikerRUS reopened this Sep 7, 2021
@StrikerRUS
Copy link
Collaborator

Closing-reopening ...

One more time.

@jameslamb
Copy link
Collaborator

After multiple close-and-reopens with the QEMU builds still timing out, I think we need to merge #4600 before this one.

@StrikerRUS StrikerRUS merged commit 5857ef5 into microsoft:master Sep 9, 2021
@jmoralez jmoralez deleted the tests/workers-hostname branch September 22, 2021 13:37
@github-actions
Copy link

This pull request has been automatically locked since there has not been any recent activity since it was closed. To start a new related discussion, open a new issue at https://github.com/microsoft/LightGBM/issues including a reference to this.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Aug 23, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

KeyError: 'pop from an empty set' error in _machines_to_worker_map() function
3 participants