Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Datasets #6

Closed
aburkard opened this issue Aug 3, 2019 · 21 comments
Closed

Datasets #6

aburkard opened this issue Aug 3, 2019 · 21 comments

Comments

@aburkard
Copy link

aburkard commented Aug 3, 2019

Are the datasets discussed in the paper publically available? Specifically the selfie2anime images.

@0xdade
Copy link

0xdade commented Aug 3, 2019

The selfie dataset appears to be this one: https://www.crcv.ucf.edu/data/Selfie/

Since the paper says they scraped anime-planet themselves to get the anime images, it seems like we'll have to yield to them for their dataset. Alternatively, there appears to be a dataset made available here that might work. http://www.nurs.or.jp/~nagadomi/animeface-character-dataset/

@taki0112
Copy link
Owner

taki0112 commented Aug 5, 2019

We are currently checking the license issue to make the dataset public.
Please wait a little.

@yorickvP
Copy link

yorickvP commented Aug 6, 2019

https://www.gwern.net/Danbooru2018 with some filters would be a great anime face dataset.

@gwern
Copy link

gwern commented Aug 6, 2019

Note that the nagadomi faces are also on Kaggle, and there's at least 2 anime face datasets derived from Danbooru2018: "Danbooru 2018 Anime Character Recognition Dataset" and SeePrettyFace.com: face dataset, in addition to the ones I made for my StyleGAN/BigGAN projects but haven't formally released.

@tafseerahmed
Copy link

Note that the nagadomi faces are also on Kaggle, and there's at least 2 anime face datasets derived from Danbooru2018: "Danbooru 2018 Anime Character Recognition Dataset" and SeePrettyFace.com: face dataset, in addition to the ones I made for my StyleGAN/BigGAN projects but haven't formally released.

The one of SeePrettyFace.com are a pain in the ass to download. Require's me to download baidu's downloader and register in Chinese (I believe).

@amouclesCR
Copy link

Hi, I have a question, I run python main.py --dataset selfie2anime but I not sure if it is working.
I know it is weird quiestion, I new in these

@sdy0803
Copy link

sdy0803 commented Aug 7, 2019

Hi, I have a question, I run python main.py --dataset selfie2anime but I not sure if it is working.
I know it is weird quiestion, I new in these

'cuz the dataset is not yet included here

@BenZstory
Copy link

You can also try this anime_faces dataset that I parsed from the tfrecords of twingan project.

As for a replacement of selfie dataset, you can try celebA and even CelebAMask-HQ(this can help you generate a high-res portraits dataset without backgrounds)

@tafseerahmed
Copy link

You can also try this anime_faces dataset that I parsed from the tfrecords of twingan project.

As for a replacement of selfie dataset, you can try celebA and even CelebAMask-HQ(this can help you generate a high-res portraits dataset without backgrounds)

In the directory structure of README.md doesn't it say that the training set should be jpg or png's? (haven't read the source code).

@sdy0803
Copy link

sdy0803 commented Aug 8, 2019

  1. How to setup a checkpoint? it keeps saying loading checkpoint failed.
  2. i'm using GTX1060 6GB. Should I readjust batch_size to avoid 'resource exhausted' issue?

Thx

@Bruce-YC
Copy link

Bruce-YC commented Aug 9, 2019

@sdy0803
You can change checkpoint save frequency in main.py. If you have any checkpoint saved, it will probably load successfully.

@sdy0803
Copy link

sdy0803 commented Aug 9, 2019

@sdy0803
You can change checkpoint save frequency in main.py. If you have any checkpoint saved, it will probably load successfully.

The thing is that i find my GTX 1060 6GB cannot even run through the whole training progress with a miserable training dataset size of 140 pictures

@Bruce-YC
Copy link

Bruce-YC commented Aug 9, 2019

According to #3
Their setup was

One NVIDIA V100 32GB GPU.
It takes 4 days.

So it is not so surprising that it will take much longer with 1060.
I finished the training by significantly reducing number of epoch and training iteration (obviously produced terrible results). If you just want to finish training, then you can try the same.

@sdy0803
Copy link

sdy0803 commented Aug 9, 2019

thx. let me give it one more try

@tafseerahmed
Copy link

Dataset for Anime images 5K from http://www.seeprettyface.com

@heart4lor
Copy link

Here's my dataset:

And I did some preparations:

According to the paper 5.2. Dataset, I wrote this script and selected 3400 female selfies(but the selfie labels seems contains some errors so there's still some male selfies) as trainset and 100 as testset. relatively, I choose the biggest 3500 anime pictures as anime trainset and testset.

You can download this 2*3500 dataset from here.

This dataset still can be improved, especially the selfie dataset. If the angle and position can be more corresponding with the anime, I think the preference will be better. as a matter of fact, these samples manually picked above are those selfies relatively good.

@taki0112
Copy link
Owner

taki0112 commented Aug 15, 2019

  1. We released 50 epoch and 100 epoch checkpoints so that people could test more widely.

  2. Also, We published the selfie2anime datasets we used in the paper.

  3. And, we fixed code in smoothing

  4. In the test image, I recommend that your face be in the center.

@QQ2737499951
Copy link

数据集和模型下载

==========================
链接:https://pan.baidu.com/s/1dP1mXuU-rA9dPvFe8YS8jQ
提取码:k6rc

已添加checkpoint文件

@FantasyJXF
Copy link

You can also try this anime_faces dataset that I parsed from the tfrecords of twingan project.

As for a replacement of selfie dataset, you can try celebA and even CelebAMask-HQ(this can help you generate a high-res portraits dataset without backgrounds)

Thanks for your sharing. Did you retrain the model with your anime dataset? Since they are in low resolution, did it affects?

@FantasyJXF
Copy link

Here's my dataset:

And I did some preparations:

According to the paper 5.2. Dataset, I wrote this script and selected 3400 female selfies(but the selfie labels seems contains some errors so there's still some male selfies) as trainset and 100 as testset. relatively, I choose the biggest 3500 anime pictures as anime trainset and testset.

You can download this 2*3500 dataset from here.
This dataset still can be improved, especially the selfie dataset. If the angle and position can be more corresponding with the anime, I think the preference will be better. as a matter of fact, these samples manually picked above are those selfies relatively good.

That's very nice summary, I think the dataset the author use was not so good for selfies, it's so disperse. As you said, maybe we should train with specific selfies, such as registration photo?

So, did you retrain the model with your new datasets? How's the result look like?

@qweasdzxc110
Copy link

Dataset for Anime images 5K from http://www.seeprettyface.com

link of google drives is dead, can you update the link?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests