Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WARNING - Couldn't gather 1 keys, rescheduling xxx #2095

Closed
Cherrymelon opened this issue Jul 4, 2018 · 1 comment
Closed

WARNING - Couldn't gather 1 keys, rescheduling xxx #2095

Cherrymelon opened this issue Jul 4, 2018 · 1 comment

Comments

@Cherrymelon
Copy link

code as below:

# -*- coding: utf-8 -*-
from dask import distributed
from distributed import Client
import dask
import socket


def writer(filename,data):
    with open(filename,'w') as f:
        f.writelines(data)

def get_ip():
    a = 'hostname:{}'.format(socket.gethostname())
    writer('/data/3.txt',a)
client = Client('39.104.173.254:8786')

A=client.submit(get_ip)
print(client.ncores())
b=A.result()

the output in console is :

{'tcp://172.18.0.52:33651': 8, 'tcp://172.24.197.177:43392': 1}
distributed.client - WARNING - Couldn't gather 1 keys, rescheduling {'get_ip-4d27f6f526354995604a58f078f95159': ('tcp://172.18.0.52:33651',)}

the output in scheduler is :

distributed.scheduler - INFO - Starting worker compute stream, tcp://172.18.0.52:33651
distributed.core - INFO - Starting established connection
distributed.scheduler - INFO - Receive client connection: Client-d4cd8210-7f80-11e8-a8ca-59b675e390f3
distributed.core - INFO - Starting established connection
distributed.scheduler - INFO - Remove worker tcp://172.18.0.52:33651
distributed.core - INFO - Removing comms to tcp://172.18.0.52:33651
distributed.scheduler - ERROR - Workers don't have promised key: ['tcp://172.18.0.52:33651'], get_ip-4d27f6f526354995604a58f078f95159
NoneType: None
distributed.scheduler - INFO - Remove client Client-d4cd8210-7f80-11e8-a8ca-59b675e390f3
distributed.scheduler - INFO - Remove client Client-d4cd8210-7f80-11e8-a8ca-59b675e390f3
distributed.scheduler - INFO - Close client connection: Client-d4cd8210-7f80-11e8-a8ca-59b675e390f3

the output in 52 is :

(py36) rui@jieyu_vi_2:~/project/tt$ dask-worker 39.104.173.254:8786
distributed.nanny - INFO -         Start Nanny at: 'tcp://172.18.0.52:37264'
distributed.worker - INFO -       Start worker at:    tcp://172.18.0.52:33651
distributed.worker - INFO -          Listening to:    tcp://172.18.0.52:33651
distributed.worker - INFO -              nanny at:          172.18.0.52:37264
distributed.worker - INFO -              bokeh at:           172.18.0.52:8789
distributed.worker - INFO - Waiting to connect to:  tcp://39.104.173.254:8786
distributed.worker - INFO - -------------------------------------------------
distributed.worker - INFO -               Threads:                          8
distributed.worker - INFO -                Memory:                   33.65 GB
distributed.worker - INFO -       Local Directory: /home/rui/project/tt/dask-worker-space/worker-fwgyg7g1
distributed.worker - INFO - -------------------------------------------------
distributed.worker - INFO -         Registered to:  tcp://39.104.173.254:8786
distributed.worker - INFO - -------------------------------------------------
distributed.core - INFO - Starting established connection
distributed.worker - INFO - Stopping worker at tcp://172.18.0.52:33651
distributed.nanny - INFO - Closing Nanny at 'tcp://172.18.0.52:37264'
distributed.dask_worker - INFO - End worker

177 machine is in cloud,52 is in company LAN.I haven't found any useful referrence about this problem

@Cherrymelon
Copy link
Author

this is a problem that cross LAN and Internet. 1258 solved my problem

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant