Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tqdm process_map doesn't work with PyPy #1409

Open
5 of 6 tasks
eblis opened this issue Dec 18, 2022 · 1 comment
Open
5 of 6 tasks

Tqdm process_map doesn't work with PyPy #1409

eblis opened this issue Dec 18, 2022 · 1 comment

Comments

@eblis
Copy link

eblis commented Dec 18, 2022

  • I have marked all applicable categories:
    • exception-raising bug
    • visual output bug
  • I have visited the [source website], and in particular
    read the [known issues]
  • I have searched through the [issue tracker] for duplicates
  • I have mentioned version numbers, operating system and
    environment, where applicable:
4.64.1 3.9.15 (21401ebc2df332b6be6e3d364a985e951a72bbbd, Dec 05 2022, 18:37:18)
[PyPy 7.3.10 with MSC v.1929 64 bit (AMD64)] win32
    values = process_map(self.count, candidates, max_workers=8, ncols=100, desc="Candidates", position=0)
  File "C:\Program Files\PyPy\lib\site-packages\tqdm\contrib\concurrent.py", line 130, in process_map
    return _executor_map(ProcessPoolExecutor, fn, *iterables, **tqdm_kwargs)
  File "C:\Program Files\PyPy\lib\site-packages\tqdm\contrib\concurrent.py", line 76, in _executor_map
    return list(tqdm_class(ex.map(fn, *iterables, **map_args), **kwargs))
  File "C:\Program Files\PyPy\Lib\concurrent\futures\process.py", line 752, in map
    results = super().map(partial(_process_chunk, fn),
  File "C:\Program Files\PyPy\Lib\concurrent\futures\_base.py", line 598, in map
    fs = [self.submit(fn, *args) for args in zip(*iterables)]
  File "C:\Program Files\PyPy\Lib\concurrent\futures\_base.py", line 598, in <listcomp>
    fs = [self.submit(fn, *args) for args in zip(*iterables)]
  File "C:\Program Files\PyPy\Lib\concurrent\futures\process.py", line 723, in submit
    self._adjust_process_count()
AttributeError: 'ProcessPoolExecutor' object has no attribute '_adjust_process_count'
@eblis
Copy link
Author

eblis commented Dec 19, 2022

I've raised an issue with PyPy, this seems to be a problem with their ProcessPoolExecutor, not tqdm.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant