Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add japanese support and other fix #18

Merged
merged 113 commits into from
Sep 12, 2023
Merged

add japanese support and other fix #18

merged 113 commits into from
Sep 12, 2023

Conversation

Stardust-minus
Copy link
Member

No description provided.

@Stardust-minus
Copy link
Member Author

Dataloader在num_worker参数不为0时训练概率出现死锁问题,导致训练卡死,仍待解决

@Stardust-minus
Copy link
Member Author

Stardust-minus commented Sep 7, 2023

默认使用gloo backend.使用torchrun替换spawn

@qiaokesi
Copy link

可以增加对英语的支持吗,有的场景会有中英混合的情况。

@leng-yue
Copy link
Member

可以增加对英语的支持吗,有的场景会有中英混合的情况。

我估计会开个新的 branch 来做这个, 希望这个 dev 尽快 merge... 不然后续 conflict 很麻烦...

@leng-yue leng-yue merged commit 699ca71 into master Sep 12, 2023
2 checks passed
@leng-yue leng-yue deleted the dev branch September 17, 2023 08:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants