-
-
Notifications
You must be signed in to change notification settings - Fork 717
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Can't figure out what Dask wants in terms of msgpack/msgpack-python #3876
Comments
Hi @rjurney ! Oof, that sounds frustrating. Dask requries I'm actually quite surprised that conda let you have that version of msgpack-python installed. We currently pin to |
@mrocklin The latest version of I see newer version here though: https://anaconda.org/anaconda/msgpack-python/files |
If you're downloading from PyPI then you want the msgpack package:
https://pypi.org/project/msgpack/
If you're downloading from conda-forge there is a conflict because there
are many msgpack packages. The python one is called msgpack-python.
Regardless, if you follow the install instructions at
https://docs.dask.org/en/latest/install.html then your package manager (pip
or conda) should ensure that you have the right packages necessary to run
Dask.
…On Tue, Jun 9, 2020 at 5:17 PM Russell Jurney ***@***.***> wrote:
@mrocklin <https://github.com/mrocklin> The latest version of
msgpack-python on PyPi is 0.5.6. See:
https://pypi.org/project/msgpack-python/#files
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#3876 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AACKZTC2DYSHQIGPQXJ6BG3RV3GJPANCNFSM4NZ3P4VQ>
.
|
@mrocklin The instructions assume a good version gets installed as a dependency of Dask and it does not. They don't speak as to msgpack. I have I can't figure out what Dask wants from me, it makes no sense. I did what I'm supposed to do and the right package is installed.
|
@mrocklin I removed all msgpack and msgpack-python modules and installed msgpack from pip. pip freeze shows: Now I get this error: TypeError: Data serialized with pickle but only able to deserialize data with ['msgpack']
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.comm.tcp - WARNING - Closing dangling stream in <TCP local=tcp://127.0.0.1:35126 remote=tcp://127.0.0.1:8786>
distributed.dashboard.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not None
AssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not None
AssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not None
AssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not None
AssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not None
AssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not None
AssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not None
AssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:
Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not None
AssertionError |
You shouldn't have to explicitly install msgpack. Can you verify that
you've done the instructions in https://docs.dask.org/en/latest/install.html .
Your package manager will handle this for you.
…On Tue, Jun 9, 2020 at 5:33 PM Russell Jurney ***@***.***> wrote:
@mrocklin <https://github.com/mrocklin> I removed all msgpack and
msgpack-python modules and installed msgpack from pip.
Now I get this error:
TypeError: Data serialized with pickle but only able to deserialize data with ['msgpack']distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.comm.tcp - WARNING - Closing dangling stream in <TCP local=tcp://127.0.0.1:35126 remote=tcp://127.0.0.1:8786>distributed.dashboard.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxydistributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>distributed.process - INFO - reaping stray process <SpawnProcess(Dask Worker process (from Nanny), started daemon)>Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not NoneAssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not NoneAssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not NoneAssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not NoneAssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not NoneAssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not NoneAssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not NoneAssertionError
Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:Traceback (most recent call last):
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py", line 234, in _watch_process
assert exitcode is not NoneAssertionError
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<#3876 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AACKZTAC3NRK7TVMJVZKN23RV3IFHANCNFSM4NZ3P4VQ>
.
|
And I'd recommend creating a clean conda or virtual environment to test out
the instructions at https://docs.dask.org/en/latest/install.html. Pip and
sometimes conda can struggle to install packages into currently broken
environments.
On Tue, Jun 9, 2020 at 10:16 PM Matthew Rocklin <notifications@github.com>
wrote:
… You shouldn't have to explicitly install msgpack. Can you verify that
you've done the instructions in
https://docs.dask.org/en/latest/install.html .
Your package manager will handle this for you.
On Tue, Jun 9, 2020 at 5:33 PM Russell Jurney ***@***.***>
wrote:
> @mrocklin <https://github.com/mrocklin> I removed all msgpack and
> msgpack-python modules and installed msgpack from pip.
>
> Now I get this error:
>
> TypeError: Data serialized with pickle but only able to deserialize data
with ['msgpack']distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.comm.tcp - WARNING - Closing dangling stream in <TCP
local=tcp://127.0.0.1:35126 remote=tcp://127.0.0.1:8786>distributed.dashboard.proxy
- INFO - To route to workers diagnostics web server please install
jupyter-server-proxy: python -m pip install
jupyter-server-proxydistributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started
daemon)>distributed.process - INFO - reaping stray process
<SpawnProcess(Dask Worker process (from Nanny), started daemon)>Exception
in thread AsyncProcess Dask Worker process (from Nanny) watch process
join:Traceback (most recent call last):
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in
_bootstrap_inner
> self.run()
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in
run
> self._target(*self._args, **self._kwargs)
> File
"/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py",
line 234, in _watch_process
> assert exitcode is not NoneAssertionError
> Exception in thread AsyncProcess Dask Worker process (from Nanny) watch
process join:Traceback (most recent call last):
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in
_bootstrap_inner
> self.run()
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in
run
> self._target(*self._args, **self._kwargs)
> File
"/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py",
line 234, in _watch_process
> assert exitcode is not NoneAssertionError
> Exception in thread AsyncProcess Dask Worker process (from Nanny) watch
process join:Traceback (most recent call last):
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in
_bootstrap_inner
> self.run()
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in
run
> self._target(*self._args, **self._kwargs)
> File
"/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py",
line 234, in _watch_process
> assert exitcode is not NoneAssertionError
> Exception in thread AsyncProcess Dask Worker process (from Nanny) watch
process join:Traceback (most recent call last):
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in
_bootstrap_inner
> self.run()
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in
run
> self._target(*self._args, **self._kwargs)
> File
"/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py",
line 234, in _watch_process
> assert exitcode is not NoneAssertionError
> Exception in thread AsyncProcess Dask Worker process (from Nanny) watch
process join:Traceback (most recent call last):
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in
_bootstrap_inner
> self.run()
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in
run
> self._target(*self._args, **self._kwargs)
> File
"/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py",
line 234, in _watch_process
> assert exitcode is not NoneAssertionError
> Exception in thread AsyncProcess Dask Worker process (from Nanny) watch
process join:Traceback (most recent call last):
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in
_bootstrap_inner
> self.run()
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in
run
> self._target(*self._args, **self._kwargs)
> File
"/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py",
line 234, in _watch_process
> assert exitcode is not NoneAssertionError
> Exception in thread AsyncProcess Dask Worker process (from Nanny) watch
process join:Traceback (most recent call last):
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in
_bootstrap_inner
> self.run()
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in
run
> self._target(*self._args, **self._kwargs)
> File
"/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py",
line 234, in _watch_process
> assert exitcode is not NoneAssertionError
> Exception in thread AsyncProcess Dask Worker process (from Nanny) watch
process join:Traceback (most recent call last):
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 926, in
_bootstrap_inner
> self.run()
> File "/home/ubuntu/anaconda3/lib/python3.7/threading.py", line 870, in
run
> self._target(*self._args, **self._kwargs)
> File
"/home/ubuntu/anaconda3/lib/python3.7/site-packages/distributed/process.py",
line 234, in _watch_process
> assert exitcode is not NoneAssertionError
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <#3876 (comment)
>,
> or unsubscribe
> <
https://github.com/notifications/unsubscribe-auth/AACKZTAC3NRK7TVMJVZKN23RV3IFHANCNFSM4NZ3P4VQ
>
> .
>
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#3876 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AAKAOIQEZQNOXUHTEEFZWQTRV33IPANCNFSM4NZ3P4VQ>
.
|
@TomAugspurger I got it to work in a clean environment, thanks. |
I had these package preinstalled before Dask and distributed where installed: Dask distributed package pulls in msg pack. To ensure scheduler and workers have same pip packages. Un install msg pack and allow distributed install it. pip uninstall msgpack-python Install dask and distributed only: Distributed will pull msgpack Client connect should work then
|
I can't figure out what Dask wants in terms of msgpack/msgpack-python and I've read all about it. I am trying to run it in distributed mode, but my workers die. I fixed this once but lost the solution and the default setup doesn't work so I have to run workers manually.
The command I run:
nohup dask-scheduler & dask-worker --nprocs 2 --nthreads 2 127.0.0.1:8786
What happened: I get this result:
What you expected to happen:
I expect the workers to live. Instead they die. I can't figure out what Dask wants in terms of
msgpack
.Anything else we need to know?:
Can someone please tell me how to setup my environment in a way Dask likes regarding
msgpack
/msgpack-python
? I first used pip to install both then found a bug fix that said use conda so I did. That did not help.Environment:
pip freeze:
The text was updated successfully, but these errors were encountered: