New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Targeting 2024 Q2] Dataloader crashes after enabling persistent_workers=True
#48964
Comments
您好,我们已经收到了您的问题,会安排技术人员尽快解答您的问题,请耐心等待。请您再次检查是否提供了清晰的问题描述、复现代码、环境&版本、报错信息等。同时,您也可以通过查看官网API文档、常见问题、历史Issue、AI社区来寻求解答。祝您生活愉快~ Hi! We've received your issue and please be patient to get responded. We will arrange technicians to answer your questions as soon as possible. Please make sure that you have posted enough message to demo your request. You may also check out the API,FAQ,Github Issue and AI community to get the answer.Have a nice day! |
There's a related issue that was opened last year and remains unresolved. (#32927) |
|
已排期,Q2内修复~ |
请问是否有更新? |
@heavengate said this task will be targeted in 23 Q3 |
persistent_workers=True
persistent_workers=True
@onecatcn done? |
not yet |
@xysheng-baidu sheng will investigate the issue |
persistent_workers=True
persistent_workers=True
Same here |
The problem has not been solved yet, we will deal with it as soon as possible. |
persistent_workers=True
persistent_workers=True
persistent_workers=True
persistent_workers=True
bug描述 Describe the Bug
As a benchmark, I only need to train a few steps per epoch. So, I add a
break
in the loop. For example:It works fine if I set
persistent_workers=False
. But after settingpersistent_workers=True
, I got this error:Here is the complete code to reproduce:
其他补充信息 Additional Supplementary Information
No response
The text was updated successfully, but these errors were encountered: