Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DDP mode and amp #13

Closed
apxlwl opened this issue Jul 18, 2022 · 4 comments
Closed

DDP mode and amp #13

apxlwl opened this issue Jul 18, 2022 · 4 comments

Comments

@apxlwl
Copy link

apxlwl commented Jul 18, 2022

�你好，非常感谢您的工作，但在多卡使用时出现了如下问题想请教：
https://github.com/median-research-group/LibMTL/blob/main/LibMTL/weighting/abstract_weighting.py#L43
image

配置：�MGDA+hardParam

另外还有个问题想请教一下：

  1. 项目中的weighter�类型有哪些和半精度amp训练兼容？ 兼容的话应该在scale之前进行weighting还是scale之后weighting？
@Baijiong-Lin
Copy link
Collaborator

你好, 目前LibMTL暂不支持多卡DDP以及混合精度AMP. 这些功能仍在开发测试中, 我们会在后续版本中推出这些功能, 请持续关注.

@apxlwl apxlwl closed this as completed Jul 19, 2022
@pierrelzw
Copy link

DDP的支持在开发中了么？预计什么时候会有呢？

你好, 目前LibMTL暂不支持多卡DDP以及混合精度AMP. 这些功能仍在开发测试中, 我们会在后续版本中推出这些功能, 请持续关注.

@Baijiong-Lin
Copy link
Collaborator

你好，我们目前仍在推进v1.1.6的版本，DDP和AMP的支持预计会在v1.1.7的版本上线，请持续关注。

@ailias
Copy link

ailias commented Jun 20, 2023

DDP版本有了吗？提供一个demo也行。感谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@ailias @pierrelzw @apxlwl @Baijiong-Lin