Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

stylex_train_new #12

Open
zmehdiz97 opened this issue Jul 13, 2022 · 0 comments
Open

stylex_train_new #12

zmehdiz97 opened this issue Jul 13, 2022 · 0 comments

Comments

@zmehdiz97
Copy link

zmehdiz97 commented Jul 13, 2022

Hello,
Thank you for this implementation. I have several quetions:

  • I am trying to train stylex on BDD dataset (driving scenes) and i was wondering what is the difference between stylex_train_new and stylex_train? I saw that in th new code you set a lower learning rate for the encoder which helped me stabilize the training and avoid big loss values.

  • I have another question regarding the encoder. you seem to have tested other encoder architechtures other than the discriminator architechture. Did you get better results using other architectures? In my training the encoder is recontructing almost the same image at each step. At first I thought it was a mode collapse but when I checked images generated without the encoder they were more diverse.

  • In early training ( iteration < 15k) I always have a mode collapse. I am using a total batch size of 32 (4 gpus) and a gradient accumulation=4 and img_size=64. Do you have any advice to prevent mode collapse?
    Generated images at iteration 3250 (not generated using encoder)
    65-

  • Is using a batch size of 8 and gradient accumulation of 4 equivalent to batch size of 32 and gradient accumulation = 1 in your implementation?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant