Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change processor to prevent errors in python>=3.7 #236

Merged
merged 3 commits into from
Mar 2, 2020

Commits on Feb 27, 2020

  1. Change processor to prevent errors in python>=3.7

    While processing data with bootstrax I noticed errors while processing data with python3.7 or python3.8. Changing this option solves the errors.
    
    The error message is added below for convenience (in python 3.7):
    Traceback (most recent call last):
      File "/home/xedaq/miniconda/envs/py37/lib/python3.7/threading.py", line 926, in _bootstrap_inner
        self.run()
      File "/home/xedaq/miniconda/envs/py37/lib/python3.7/threading.py", line 870, in run
        self._target(*self._args, **self._kwargs)
      File "/home/xedaq/miniconda/envs/py37/lib/python3.7/concurrent/futures/process.py", line 375, in _queue_management_worker
        thread_wakeup.clear()
      File "/home/xedaq/miniconda/envs/py37/lib/python3.7/concurrent/futures/process.py", line 93, in clear
        while self._reader.poll():
      File "/home/xedaq/miniconda/envs/py37/lib/python3.7/multiprocessing/connection.py", line 255, in poll
        self._check_closed()
      File "/home/xedaq/miniconda/envs/py37/lib/python3.7/multiprocessing/connection.py", line 136, in _check_closed
        raise OSError("handle is closed")
    OSError: handle is closed
    
    or in python 3.8:
    	Traceback (most recent call last):
    	  File "/home/xedaq/miniconda/envs/py38/lib/python3.8/threading.py", line 932, in _bootstrap_inner
    	    self.run()
    	  File "/home/xedaq/miniconda/envs/py38/lib/python3.8/threading.py", line 870, in run
    	    self._target(*self._args, **self._kwargs)
    	  File "/home/xedaq/miniconda/envs/py38/lib/python3.8/concurrent/futures/process.py", line 376, in _queue_management_worker
    	    thread_wakeup.clear()
    	  File "/home/xedaq/miniconda/envs/py38/lib/python3.8/concurrent/futures/process.py", line 94, in clear
    	    self._reader.recv_bytes()
    	  File "/home/xedaq/miniconda/envs/py38/lib/python3.8/multiprocessing/connection.py", line 216, in recv_bytes
    	    buf = self._recv_bytes(maxlength)
    	  File "/home/xedaq/miniconda/envs/py38/lib/python3.8/multiprocessing/connection.py", line 414, in _recv_bytes
    	    buf = self._recv(4)
    	  File "/home/xedaq/miniconda/envs/py38/lib/python3.8/multiprocessing/connection.py", line 379, in _recv
    	 77602 MainThread ThreadedMailboxProcessor Waiting for subprocesses to end
    	    chunk = read(handle, remaining)
    	OSError: [Errno 9] Bad file descriptor
    JoranAngevaare committed Feb 27, 2020
    Configuration menu
    Copy the full SHA
    128a0a5 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2020

  1. Wait on executors

    This could potentially infinite hangs on bad crashes, but should be better for normal processing
    JelleAalbers committed Mar 2, 2020
    Configuration menu
    Copy the full SHA
    09a798b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    336a91a View commit details
    Browse the repository at this point in the history