Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

trainning stragegy #6

Closed
ecnuycxie opened this issue Jun 22, 2021 · 4 comments
Closed

trainning stragegy #6

ecnuycxie opened this issue Jun 22, 2021 · 4 comments

Comments

@ecnuycxie
Copy link

Hello, thank you for your impressive work.
I noticed that you set'max_iter' to 800,000, and the training data set contains 439 different styles (each has nearly 6000 characters).
When I set 'batch' to 8, the epoch is between 2 and 3 (which makes me feel strange).
Am I right?

@8uos
Copy link
Collaborator

8uos commented Jun 22, 2021

Hi, thanks for your question.
For the generative models, usually, the number of iterations is more critical than the number of epochs.
We observed that 650,000 iterations are enough for our model (with 6 experts).
Also, a data point actually includes more than one image (7 images in this code; 3 style images, 3 content images, 1 target image), so the model looks 8 * 7 = 56 images per every iteration, that is much more images than you guessed.

@ecnuycxie
Copy link
Author

ecnuycxie commented Jun 25, 2021

Thanks for your reply!
I still wonder that from which metrics do you observed that the iterations are enough?

@8uos
Copy link
Collaborator

8uos commented Jun 28, 2021

I'm sorry for that the metrics such as reported losses do not clearly reflects the quality of generated images, like many other generative models.
However, we observed that the quality of generated images goes better when the accuracies of content and style classifier with generated images (reported as AC_g_acc_c and AC_g_acc_s) become larger.

@SanghyukChun
Copy link
Collaborator

Closing the issue, assuming the answer resolves the problem.
Please re-open the issue as necessary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants