Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Token Labeling #8

Open
monney opened this issue Jun 26, 2021 · 9 comments
Open

Token Labeling #8

monney opened this issue Jun 26, 2021 · 9 comments
Labels
question Further information is requested

Comments

@monney
Copy link

monney commented Jun 26, 2021

Hi, thank you for the paper.

Do you have any numbers for how the networks perform without token labeling, only using MixToken and other augmentations?

@yuanli2333
Copy link
Collaborator

Hi, token labeling can improve volo_d1 by 0.4% (from 83.8% to 84.2%). For larger volo models, token labeling can achieve improvement from 0.0 to 0.4%.

@monney
Copy link
Author

monney commented Jun 28, 2021

Thank you, I think these numbers are probably worth adding to the paper as well for context.

@yuanli2333 yuanli2333 added the question Further information is requested label Jun 28, 2021
@KleinXin
Copy link

Hi, token labeling can improve volo_d1 by 0.4% (from 83.8% to 84.2%). For larger volo models, token labeling can achieve improvement from 0.0 to 0.4%.

Could you please also put a copy of token labeling data and pretrained models on Baidu Netdisk?

@Ree1s
Copy link

Ree1s commented Jul 3, 2021

Hi,thank you for sharing this work. If I want to use VOLO to finetune on my own dataset, how can I create my own token labeling?

@zihangJiang
Copy link
Collaborator

Hi @Ree1s , You can refer to zihangJiang/TokenLabeling#7 (comment) for generating token label data for your own dataset.

@yuanli2333
Copy link
Collaborator

Hi,thank you for sharing this work. If I want to use VOLO to finetune on my own dataset, how can I create my own token labeling?

If you only want to 'finetune' VOLO on your own dataset, one option is to directly use the 'class token' or mean the feature tokens without using token labeling, thus you don't need to generate your own token labels.

@Ree1s
Copy link

Ree1s commented Jul 5, 2021

Hi @Ree1s , You can refer to zihangJiang/TokenLabeling#7 (comment) for generating token label data for your own dataset.

Thanks, and I will try on my dataset through this way mentioned.

@Ree1s
Copy link

Ree1s commented Jul 5, 2021

Hi,thank you for sharing this work. If I want to use VOLO to finetune on my own dataset, how can I create my own token labeling?

If you only want to 'finetune' VOLO on your own dataset, one option is to directly use the 'class token' or mean the feature tokens without using token labeling, thus you don't need to generate your own token labels.

I'll have a try. Thanks a lot!

@chengengliu
Copy link

Hi,thank you for sharing this work. If I want to use VOLO to finetune on my own dataset, how can I create my own token labeling?

If you only want to 'finetune' VOLO on your own dataset, one option is to directly use the 'class token' or mean the feature tokens without using token labeling, thus you don't need to generate your own token labels.

Hi, when you say class token, do you mean configure return_mean to True the feeding parameters of VOLO?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

6 participants