distributed.worker - INFO - Listening to: tcp://192.168.51.34:39333 distributed.worker - INFO - Listening to: tcp://192.168.51.34:43653 /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:46167 distributed.worker - INFO - dashboard at: 192.168.51.34:35643 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - dashboard at: 192.168.51.34:37913 distributed.worker - INFO - dashboard at: 192.168.51.34:35455 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - Listening to: tcp://192.168.51.34:46167 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:37603 distributed.worker - INFO - Listening to: tcp://192.168.51.34:37603 distributed.worker - INFO - Threads: 1 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - dashboard at: 192.168.51.34:44369 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:38905 distributed.worker - INFO - Listening to: tcp://192.168.51.34:38905 /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:46823 distributed.worker - INFO - dashboard at: 192.168.51.34:37447 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - dashboard at: 192.168.51.34:42035 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-kyh_iie9 distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Listening to: tcp://192.168.51.34:46823 distributed.worker - INFO - dashboard at: 192.168.51.34:46491 distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-jfn_cam3 distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-v4hszh5a distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Memory: 3.92 GiB /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:41123 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-9cik41pg distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-i71q0id4 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-x408mfuy distributed.worker - INFO - Listening to: tcp://192.168.51.34:41123 distributed.worker - INFO - dashboard at: 192.168.51.34:33649 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-yz7e1im4 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-rlqjkb6w distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - ------------------------------------------------- /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:38411 /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:37621 distributed.worker - INFO - Listening to: tcp://192.168.51.34:38411 distributed.worker - INFO - dashboard at: 192.168.51.34:39855 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Listening to: tcp://192.168.51.34:37621 distributed.worker - INFO - dashboard at: 192.168.51.34:44235 distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-ijrfojuj distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-3lh_20pi distributed.worker - INFO - ------------------------------------------------- /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:44591 distributed.worker - INFO - Listening to: tcp://192.168.51.34:44591 distributed.worker - INFO - dashboard at: 192.168.51.34:42167 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-89rr57ta /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:35869 distributed.worker - INFO - Listening to: tcp://192.168.51.34:35869 distributed.worker - INFO - dashboard at: 192.168.51.34:39929 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-rgcluptn distributed.worker - INFO - ------------------------------------------------- /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:41395 distributed.worker - INFO - Listening to: tcp://192.168.51.34:41395 distributed.worker - INFO - dashboard at: 192.168.51.34:43061 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-dbym3qwc distributed.worker - INFO - ------------------------------------------------- /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:39315 distributed.worker - INFO - Listening to: tcp://192.168.51.34:39315 distributed.worker - INFO - dashboard at: 192.168.51.34:40757 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-xfmywjbg /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:40541 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Listening to: tcp://192.168.51.34:40541 distributed.worker - INFO - dashboard at: 192.168.51.34:38681 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-e8hsf18b distributed.worker - INFO - ------------------------------------------------- /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) distributed.worker - INFO - Start worker at: tcp://192.168.51.34:33739 distributed.worker - INFO - Listening to: tcp://192.168.51.34:33739 distributed.worker - INFO - dashboard at: 192.168.51.34:44933 distributed.worker - INFO - Waiting to connect to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.worker - INFO - Threads: 1 distributed.worker - INFO - Memory: 3.92 GiB distributed.worker - INFO - Local Directory: /tmp/dask-worker-space/dask-worker-space/worker-9tudwed2 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Register worker distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:34071 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:41883 distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:36733 distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:38983 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:38409 distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:39683 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:33919 distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:39653 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:38209 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:38905 distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:46823 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:39333 distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:37947 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:37603 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:46167 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:46437 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:37487 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:36937 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:43079 distributed.core - INFO - Starting established connection distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:41123 distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:35869 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:38411 distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:37621 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:35001 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:41395 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.core - INFO - Starting established connection distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:43653 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:39315 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.core - INFO - Starting established connection distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:44591 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:40541 distributed.core - INFO - Starting established connection distributed.scheduler - INFO - Register worker distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.scheduler - INFO - Starting worker compute stream, tcp://192.168.51.34:33739 distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection distributed.worker - INFO - Registered to: tcp://192.168.51.34:45333 distributed.worker - INFO - ------------------------------------------------- distributed.core - INFO - Starting established connection distributed.core - INFO - Starting established connection total_bytes = 0, num_blocks = 128 block_size = 0 bytes /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.Float64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) /home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/dataframe/backends.py:189: FutureWarning: pandas.UInt64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index) [nltk_data] Downloading package punkt to /home/j/jzhang/nltk_data... [nltk_data] Package punkt is already up-to-date! Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/preprocess_bert_pretrain", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/bert/pretrain.py", line 860, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/bert/pretrain.py", line 566, in main pairs = _get_pairs( File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/bert/pretrain.py", line 391, in _get_pairs read_wikipedia( File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/readers.py", line 57, in read_wikipedia return _read_bag_of_text( File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/readers.py", line 43, in _read_bag_of_text bag_strs = db.read_text(input_files, blocksize=blocksize) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/bag/text.py", line 131, in read_text o = read_bytes( File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/dask/bytes/core.py", line 81, in read_bytes fs, fs_token, paths = get_fs_token_paths(urlpath, mode="rb", storage_options=kwargs) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/fsspec/core.py", line 615, in get_fs_token_paths raise ValueError("empty urlpath sequence") ValueError: empty urlpath sequence distributed.scheduler - INFO - Receive client connection: Client-36f1022e-2635-11ed-873c-fde5fcc35e69 distributed.core - INFO - Starting established connection distributed.worker - INFO - Run out-of-band function 'stop' distributed.scheduler - INFO - Scheduler closing... distributed.scheduler - INFO - Scheduler closing all comms distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:41883 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:36733 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:38905 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:34071 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:39683 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:46823 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:38983 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:38409 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:37947 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:37603 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:39653 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:46167 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:43079 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:37487 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:46437 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:38209 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:33919 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:39333 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:38411 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:41123 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:35869 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:36937 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:37621 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:43653 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:35001 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:41395 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:39315 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:33739 distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:40541 distributed.worker - INFO - Stopping worker at tcp://192.168.51.34:44591 distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.scheduler - INFO - Remove worker distributed.core - INFO - Removing comms to tcp://192.168.51.34:34071 distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: distributed.batched - INFO - Batched Comm Closed: -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpirun detected that one or more processes exited with non-zero status, thus causing the job to be terminated. The first process to do so was: Process name: [[60066,1],1] Exit code: 1 -------------------------------------------------------------------------- Load balancing for unbinned files ... Balancing the following 0 files into 128 shards: SUM(files.num_samples) = 0, SUM(shards.num_samples) = 0 Begin with Progress( Remaining: 128 shards with 0 samples per shard 0 shards with 1 samples per shard Ready: 0 shards ) iteration 0, Progress( Remaining: 0 shards with 1 samples per shard Ready: 128 shards ), left (nan, nan), right (nan, nan) Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): File "/home/j/jzhang/miniconda3/envs/ColoBert/bin/balance_dask_output", line 8, in sys.exit(console_script()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 399, in console_script main(attach_args().parse_args()) File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 374, in main _balance(file_paths, File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in _balance [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 342, in [shard.flush(i) for i, shard in enumerate(progress.ready_shards)] File "/home/j/jzhang/miniconda3/envs/ColoBert/lib/python3.8/site-packages/lddl/dask/load_balance.py", line 122, in flush while len(self._input_files) > 0: TypeError: object of type 'NoneType' has no len() -------------------------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. -------------------------------------------------------------------------- -------------------------------------------------------------------------- mpirun detected that one or more processes exited with non-zero status, thus causing the job to be terminated. The first process to do so was: Process name: [[58826,1],2] Exit code: 1 --------------------------------------------------------------------------