Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vision有效性验证 - 完善Vision下的训练项目 #219

Open
rentainhe opened this issue May 10, 2022 · 0 comments
Open

Vision有效性验证 - 完善Vision下的训练项目 #219

rentainhe opened this issue May 10, 2022 · 0 comments
Assignees

Comments

@rentainhe
Copy link
Contributor

rentainhe commented May 10, 2022

目前Vision下已经有的一个可以参考的projects,迁移了Swin-T的训练代码,用于Vision下进行模型的训练,但是vision中绝大部分模型的精度复现还无法保证,所以这里开启一个完善训练的projects: 用于复现vision下实现的模型的精度,并且在后续逐渐将vision下迁移的权重替换为oneflow自身训练的权重,这里是暂时的规划,需要2-3位实习生参与完成:

可参考的projects:

训练的任务,以及首批需要复现精度的模型:

Model Paper 认领人 PR
ResNet50 ResNet strikes back: An improved training procedure in timm 林松
DeiT Training data-efficient image transformers & distillation through attention
Swin-Transformer Swin Transformer: Hierarchical Vision Transformer using Shifted Windows 林德铝
DeiT III DeiT III: Revenge of ViT
  • 需要的硬件条件:8卡V100机器,能跑得下单卡256batchsize即可
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants