Skip to content
This repository has been archived by the owner on Jan 25, 2024. It is now read-only.

cannot run preprocess data(OSError: [Errno 24] Too many open files) #24

Open
SHITIANYU-hue opened this issue Mar 12, 2022 · 5 comments
Open

Comments

@SHITIANYU-hue
Copy link

When I run python preprocess_data.py -m lanegcn:

it will have this error:

image

@EloiZ
Copy link

EloiZ commented Apr 27, 2022

Hi! could you solve this issue? I encounter the same
Thanks

@wuhaoran111
Copy link

i also have this problem, does anyone has solved it?

Really confused.

@SwagJ
Copy link

SwagJ commented May 12, 2022

Add
import torch.multiprocessing torch.multiprocessing.set_sharing_strategy('file_system')
after import statements. This fix the problem for me.

@wuhaoran111
Copy link

@SwagJ Thank you. I have fixed it with sudo ulimit -n 65535 to Increase the maximum number of opening files.

@CrisCloseTheDoor
Copy link

Thank u all, I 've tried @SwagJ and @wuhaoran111 's solution both and fix the same problem

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants