Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

error when multiprocessing with memory_logger on Windows #5

Closed
fneum opened this issue Nov 7, 2019 · 1 comment
Closed

error when multiprocessing with memory_logger on Windows #5

fneum opened this issue Nov 7, 2019 · 1 comment

Comments

@fneum
Copy link
Contributor

fneum commented Nov 7, 2019

 File "C:\Users\travis\build\PyPSA\pypsa-eur\.snakemake\shadow\tmpi4zbpqvn\.snakemake\scripts\tmp1jwceb1d.solve_network.py", line 394, in <module>

    with memory_logger(filename=getattr(snakemake.log, 'memory', None), interval=30.) as mem:

  File "C:\miniconda\envs\pypsa-eur\lib\site-packages\vresutils\benchmark.py", line 161, in __enter__

    self.p.start()

  File "C:\miniconda\envs\pypsa-eur\lib\multiprocessing\process.py", line 112, in start

    self._popen = self._Popen(self)

  File "C:\miniconda\envs\pypsa-eur\lib\multiprocessing\context.py", line 223, in _Popen

    return _default_context.get_context().Process._Popen(process_obj)

  File "C:\miniconda\envs\pypsa-eur\lib\multiprocessing\context.py", line 322, in _Popen

    return Popen(process_obj)

  File "C:\miniconda\envs\pypsa-eur\lib\multiprocessing\popen_spawn_win32.py", line 89, in __init__

    reduction.dump(process_obj, to_child)

  File "C:\miniconda\envs\pypsa-eur\lib\multiprocessing\reduction.py", line 60, in dump

    ForkingPickler(file, protocol).dump(obj)

TypeError: cannot serialize '_io.TextIOWrapper' object

related: PyPSA/pypsa-eur#42

@coroa
Copy link
Member

coroa commented Nov 7, 2019

Somewhat related, but not really.

FabianHofmann added a commit that referenced this issue Nov 8, 2019
benchmark: Fix memory logger on windows (fixes #5)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants