Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cannot set num_workers=0 #323

Closed
sef43 opened this issue May 16, 2024 · 0 comments · Fixed by #322
Closed

cannot set num_workers=0 #323

sef43 opened this issue May 16, 2024 · 0 comments · Fixed by #322

Comments

@sef43
Copy link
Collaborator

sef43 commented May 16, 2024

I sometimes get errors related to peristent workers + pinned memory, e.g.:

ataloader.py 1290 _get_data
raise RuntimeError('Pin memory thread exited unexpectedly')

RuntimeError:
Pin memory thread exited unexpectedly
[rank: 2] Child process with PID 1662142 terminated with code 1. Forcefully terminating all other processes to avoid zombies 🧟

One solution is to set num_workers=0
If I try and do this I get a different error:

dataloader.py 254 __init__
raise ValueError('persistent_workers option needs num_workers > 0')

ValueError:
persistent_workers option needs num_workers > 0

The solution is in:
#322

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant