Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

iccv19 light weight face recognition challenge tips #632

Open
nttstar opened this issue Apr 16, 2019 · 177 comments

Comments

@nttstar
Copy link
Collaborator

commented Apr 16, 2019

Challenge Information:

HomePage, please read carefully about the training and testing rules.

How To Start:

Please check https://github.com/deepinsight/insightface/tree/master/iccv19-challenge for detail.

Any question can be left here.

@nttstar nttstar pinned this issue Apr 16, 2019

@borisgribkov

This comment has been minimized.

Copy link

commented Apr 18, 2019

HI @nttstar, my traditional question regarding the dataset, is it already 5-keypoints aligned? Sorry, have not downloaded it.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Apr 19, 2019

@borisgribkov Yes already aligned, so no need to further process on it.

@zhouwei5113

This comment has been minimized.

Copy link

commented Apr 19, 2019

@nttstar what's the difference between ms1m-retinaface-t1.zip and ms1m-v2(emore)?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Apr 19, 2019

@zhouwei5113 ms1m-retinaface has different clean list than ms1m-arcface and it has been re-aligned with our RetinaFace detector. You must use ms1m-retinaface to participate in this challenge, all other training-sets including ms1m-arcface are not allowed.

@leolordwz

This comment has been minimized.

Copy link

commented Apr 19, 2019

Hi, @nttstar, could you please share with us how the provided dataset generated from ms-1m aligned dataset. I tried to upscale images in ms-1m aligned dataset to 400x400, but the landmarks do not match. It would be great if you could share with us the preparation process.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Apr 20, 2019

@leolordwz it's not allowed for this challenge.

@chenshen03

This comment has been minimized.

Copy link

commented Apr 20, 2019

How can I take part in the iccv19 light weight face recognition challenge?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Apr 20, 2019

@chenshen03 Test datasets and test server will be ready soon, any question on training?

@jamessmith90

This comment has been minimized.

Copy link

commented Apr 20, 2019

@nttstar Can you provide more info about RetinaFace Detector ?

@LCorleone

This comment has been minimized.

Copy link

commented Apr 22, 2019

@nttstar
Is the test set aligned by RetinaFace? If not, will you release the RetinaFace Detector?
Many thanks!

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Apr 22, 2019

@LCorleone They're both aligned by RetinaFace, so no need to do anything on training or testing datasets.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Apr 22, 2019

@BingranHu We can get higher accuracy on LFW, CFP_FP and AgeDB_30 by the help of ms1m-retinaface.

@xizi

This comment has been minimized.

Copy link

commented Apr 22, 2019

@nttstar Hi, where is the download links of test data?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Apr 22, 2019

@xizi Not ready yet.

@GewelsJI

This comment has been minimized.

Copy link

commented Apr 24, 2019

Does the organizing association have some limitation on the number of participants?
@nttstar

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Apr 25, 2019

@grib0ed0v

This comment has been minimized.

Copy link

commented Apr 29, 2019

@nttstar When do you expect test server will be ready?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Apr 30, 2019

@grib0ed0v Soon~

@sybyun

This comment has been minimized.

Copy link

commented May 2, 2019

I have a question about the size of parameters.
Does the 20M parameters mean total (include FC layers) size or only backbone network's size?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented May 2, 2019

@sybyun
From the input layer to embedding layer.
By the way, it is 20MB size which means 5M parameters.

@chenshen03

This comment has been minimized.

Copy link

commented May 3, 2019

The test server could not log in.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented May 3, 2019

@chenshen03 what's the problem? I can login successfully.

@chenshen03

This comment has been minimized.

Copy link

commented May 3, 2019

@nttstar
The account can login normally on http://trillionpairs.deepglint.com, but there was an error when it logged on to the test server http://39.104.128.76.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented May 3, 2019

@chenshen03 sign up a new account, database not shared with deepglint server.

@chenshen03

This comment has been minimized.

Copy link

commented May 3, 2019

@nttstar The database is not shared, but the system prompts "user name or email already exists" when registering. Do we need to use a different email address to register?

Also, when I register with a new email box, I get an "unknown error". When I try to register again, "user or email already exists" will appear.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented May 4, 2019

@chenshen03 Hi, what is your old email address?

@chenshen03

This comment has been minimized.

Copy link

commented May 4, 2019

@nttstar email: chenshen@stu.xmu.edu.cn username: Shen Chen. Thank you.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented May 5, 2019

@chenshen03 Can you try again to sign up a new account with chenshen@stu.xmu.edu.cn ? We have done a cleaning.

@chenshen03

This comment has been minimized.

Copy link

commented May 5, 2019

@nttstar Successfully registered, thank you!

@paulcx

This comment has been minimized.

Copy link

commented Jun 19, 2019

@nttstar Is flops-counter approved by official for calculating FLOPs value which is just half of Mac value?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 20, 2019

@paulcx Please refer to our FLOPs counter.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 20, 2019

We have updated the ground-truth of glint dataset and all incoming submission will get the updated accuracy. We will also make update on top existing submissions soon.

@sybyun

This comment has been minimized.

Copy link

commented Jun 21, 2019

@nttstar I found very strange result from the new light image ranking list.
yajundang_test1's model name is exactly same as my image feature name of 6/13 ('20190613102605_l5_dw_conv6_fc512_image47').
I don't know how it is possible.
I didn't follow public naming rule so it can be same by accident and the first part of name couldn't be manually given.
Can you explain it?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 21, 2019

@sybyun we will check it asap, all feature files are kept, dont worry

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 21, 2019

@sybyun yujundang is our test account to submit existing features, it should be no problem.

@alphanerdj

This comment has been minimized.

Copy link

commented Jun 23, 2019

I've been trying to upload feature file multiple times since yesterday but the test server is always stuck at 1% upload. I'm in the US. Can you help check that upload is working?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 23, 2019

@alphanerdj Can you try WIN/MAC + Chrome to submit the feature? And try using another computer if it doesnot work.

@alphanerdj

This comment has been minimized.

Copy link

commented Jun 23, 2019

It started working, thanks!

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 24, 2019

LB scores are delaying as too many submissions, please wait.

@believeitmyway

This comment has been minimized.

Copy link

commented Jun 24, 2019

Can we use your baseline model as a pre-trained model?
I'd like to try finetuning of the model with different losses or parameters.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 25, 2019

@believeitmyway Yes you can. But the pretrained models from our ArcFace paper are not allowed.

@believeitmyway

This comment has been minimized.

Copy link

commented Jun 25, 2019

Thanks!

@nemonameless

This comment has been minimized.

Copy link

commented Jun 26, 2019

@nttstar please update the Chinese wechat QR code , thanks

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 27, 2019

We will accept the solutions with FLOPs<=1024^3 and model-size<=20MB for light tracks.
For large tracks: FLOPs<=30*1024^3.

@alphanerdj

This comment has been minimized.

Copy link

commented Jun 27, 2019

What about model size?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 27, 2019

@alphanerdj comment updated.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jun 28, 2019

funding pool updated: now $17000

@sefaburakokcu

This comment has been minimized.

Copy link

commented Jul 5, 2019

Hi! I use my model to extract features and submit it on the test server. The acc is 0. However, my model's performance on LFW is normal. I have also tried to submit the features to the official trillionpair's website and the result is also correct. I can not figure out the possible reason for that. My file is in the binary format and the data is 1,862,120 * 256 in float32.
Screenshot from 2019-05-27 16-58-02
Screenshot from 2019-05-27 16-57-50

@jingyi1997 I have encountered the same problem. Were you able to understand the problem and solve it?

@alphanerdj

This comment has been minimized.

Copy link

commented Jul 9, 2019

Should imageset and video set features be generated using same model to be considered in final ranking?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jul 9, 2019

@alphanerdj Using different models is allowed.

@boomberung

This comment has been minimized.

Copy link

commented Jul 10, 2019

Hello! I tried to download the solution many times from work and from home wiht Windows and Linux, but the download does not go beyond 1%, can you fix it before the deadline?

@ms-lilibeth

This comment has been minimized.

Copy link

commented Jul 10, 2019

@nttstar same problem as @boomberung has
Ubuntu 18.04 + Chrome
Could you, please, help me? Or can deadline be postponed?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jul 10, 2019

@boomberung You mean submit?

@boomberung @ms-lilibeth You can send your feature files to insightface.challenge@gmail.com, before deadline, with your username and password. One for each track at most.

@luzai

This comment has been minimized.

Copy link

commented Jul 10, 2019

@nttstar, Can we use any cloud platform for upload feature files and attach the link to the mail? Or can we send md5 of feature file and upload after deadline?

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jul 10, 2019

@luzai Yes you can use google drive or dropbox, before DDL only. I think there is no link problem for Chinese participants.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jul 11, 2019

Game closed. We will send emails to top participants.

@nttstar

This comment has been minimized.

Copy link
Collaborator Author

commented Jul 11, 2019

We have sent final check emails to top 20 participants. If you do not receive it, please contact us.

@jinwu07

This comment has been minimized.

Copy link

commented Jul 21, 2019

@nttstar Can the test server still be used for the purpose of evaluation after competition is over?
Thanks,

@Wxsang

This comment has been minimized.

Copy link

commented Jul 31, 2019

@nttstar I need to do a practical work in camera.
ms1m-retinaface is aligned by retina, the align algorithm is same as '/src/common/face_preprocess.py' ?
Thank for your help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
You can’t perform that action at this time.