Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

05 Array notebook fails #31

Closed
joelhullcio opened this issue Feb 24, 2017 · 1 comment
Closed

05 Array notebook fails #31

joelhullcio opened this issue Feb 24, 2017 · 1 comment

Comments

@joelhullcio
Copy link

The 05 Array notebook examples fails for me at
In[8]: result.compute()

Stack trace:

distributed.batched - INFO - Batched Stream Closed
distributed.batched - INFO - Batched Stream Closed
distributed.batched - INFO - Batched Stream Closed
distributed.batched - INFO - Batched Stream Closed
distributed.batched - INFO - Batched Stream Closed
distributed.utils - ERROR - ('array-original-2a9a222b2f08d90710bd5f256242af17', '172.20.10.4:51739')
Traceback (most recent call last):
  File "/opt/anaconda/lib/python2.7/site-packages/distributed/utils.py", line 149, in f
    result[0] = yield gen.maybe_future(func(*args, **kwargs))
  File "/opt/anaconda/lib/python2.7/site-packages/tornado/gen.py", line 1015, in run
    value = future.result()
  File "/opt/anaconda/lib/python2.7/site-packages/tornado/concurrent.py", line 237, in result
    raise_exc_info(self._exc_info)
  File "/opt/anaconda/lib/python2.7/site-packages/tornado/gen.py", line 1021, in run
    yielded = self.gen.throw(*exc_info)
  File "/opt/anaconda/lib/python2.7/site-packages/distributed/client.py", line 896, in _gather
    st.traceback)
  File "<string>", line 2, in reraise
KilledWorker: ('array-original-2a9a222b2f08d90710bd5f256242af17', '172.20.10.4:51739')
---------------------------------------------------------------------------
KilledWorker                              Traceback (most recent call last)
<ipython-input-8-f80778adb0dc> in <module>()
----> 1 result.compute()

/opt/anaconda/lib/python2.7/site-packages/dask/base.pyc in compute(self, **kwargs)
     77             Extra keywords to forward to the scheduler ``get`` function.
     78         """
---> 79         return compute(self, **kwargs)[0]
     80 
     81     @classmethod

/opt/anaconda/lib/python2.7/site-packages/dask/base.pyc in compute(*args, **kwargs)
    177         dsk = merge(var.dask for var in variables)
    178     keys = [var._keys() for var in variables]
--> 179     results = get(dsk, keys, **kwargs)
    180 
    181     results_iter = iter(results)

/opt/anaconda/lib/python2.7/site-packages/distributed/client.pyc in get(self, dsk, keys, restrictions, loose_restrictions, resources, **kwargs)
   1467 
   1468         try:
-> 1469             results = self.gather(futures)
   1470         except (KeyboardInterrupt, Exception) as e:
   1471             for f in futures.values():

/opt/anaconda/lib/python2.7/site-packages/distributed/client.pyc in gather(self, futures, errors, maxsize)
    976             return (self.gather(f, errors=errors) for f in futures)
    977         else:
--> 978             return sync(self.loop, self._gather, futures, errors=errors)
    979 
    980     @gen.coroutine

/opt/anaconda/lib/python2.7/site-packages/distributed/utils.pyc in sync(loop, func, *args, **kwargs)
    161         e.wait(1000000)
    162     if error[0]:
--> 163         six.reraise(type(error[0]), error[0], traceback[0])
    164     else:
    165         return result[0]

/opt/anaconda/lib/python2.7/site-packages/distributed/utils.pyc in f()
    147     def f():
    148         try:
--> 149             result[0] = yield gen.maybe_future(func(*args, **kwargs))
    150         except Exception as exc:
    151             logger.exception(exc)

/opt/anaconda/lib/python2.7/site-packages/tornado/gen.pyc in run(self)
   1013 
   1014                     try:
-> 1015                         value = future.result()
   1016                     except Exception:
   1017                         self.had_exception = True

/opt/anaconda/lib/python2.7/site-packages/tornado/concurrent.pyc in result(self, timeout)
    235             return self._result
    236         if self._exc_info is not None:
--> 237             raise_exc_info(self._exc_info)
    238         self._check_done()
    239         return self._result

/opt/anaconda/lib/python2.7/site-packages/tornado/gen.pyc in run(self)
   1019 
   1020                     if exc_info is not None:
-> 1021                         yielded = self.gen.throw(*exc_info)
   1022                         exc_info = None
   1023                     else:

/opt/anaconda/lib/python2.7/site-packages/distributed/client.pyc in _gather(self, futures, errors)
    894                             six.reraise(type(st.exception),
    895                                         st.exception,
--> 896                                         st.traceback)
    897                         except (AttributeError, KeyError):
    898                             six.reraise(CancelledError,

/opt/anaconda/lib/python2.7/site-packages/six.pyc in reraise(tp, value, tb)

KilledWorker: ('array-original-2a9a222b2f08d90710bd5f256242af17', '172.20.10.4:51739')

Running on OS X
conda environment listing attached.
I may have an incompatible version of a package installed but that isn't obvious to figure out.
I am afraid anyone else would be left to assume dask doesn't work well.

env.yml.txt

@martindurant
Copy link
Member

martindurant commented Apr 14, 2017

Would you mind upgrading your versions and trying again? I am not seeing this issue.

Is it possible that you simply ran out of memory?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants