Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

swin transformer pretrain model #9

Closed
ElliottZhen opened this issue Nov 9, 2023 · 1 comment
Closed

swin transformer pretrain model #9

ElliottZhen opened this issue Nov 9, 2023 · 1 comment

Comments

@ElliottZhen
Copy link

你好,想向您请教几个问题
1.我发现您加载预训练权重时,跳过了att_mask的预训练权重参数,请问是这样做效果更好吗,还是说其他原因。
2.还有就是swintransformer的v1版本官网没有发现256的与训练模型,请问您提供的是自己训练的吗?
谢谢你!

@Tchuanm
Copy link
Owner

Tchuanm commented Nov 9, 2023

  1. 这方面消融我没有做过消融到底哪个好,
  2. 我是自己训练的,性能和244差不多我记得。另外V2有提供256的版本,你可以直接用比较方便。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants