Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

there are some strange white areas in my result. #68

Closed
liangzimei opened this issue Dec 14, 2021 · 7 comments
Closed

there are some strange white areas in my result. #68

liangzimei opened this issue Dec 14, 2021 · 7 comments

Comments

@liangzimei
Copy link

liangzimei commented Dec 14, 2021

Thanks for your exciting work firstly.
when i use -cn lama-fourier to train my own dataset . i find there are some white areas in some train and test images (not all images, and according to my observation it is irrelevant to mask size), like below( these two images are selected from epoch33/40):
image
and
image
Do you know how to avoid this situation? Thanks in advance.

PS:
my dataset is a food image set and there are 150,000 images.
And i use this command to train my model
CUDA_VISIBLE_DEVICES=0,1,2,3 python bin/train.py -cn lama-fourier location=food data.batch_size=10 data.num_workers=8 trainer.kwargs.gpus=[0,1,2,3] trainer.kwargs.limit_train_batches=12360 optimizers.generator.lr=0.001 optimizers.discriminator.lr=0.0001

@windj007
Copy link
Collaborator

Hi! Sorry for the late reply!

Did you resolved the issue?

What are the training and testing resolutions?

@liangzimei
Copy link
Author

Hi! Sorry for the late reply!

Did you resolved the issue?

What are the training and testing resolutions?

sorry, the issue has not been solved. training resolution is 256 and testing resolution is 512.

@windj007
Copy link
Collaborator

Do these artifacts appear on training images as well?

@liangzimei
Copy link
Author

Yes, here is some training samples in last epoch.
A20220120111002

@liangzimei
Copy link
Author

Do these artifacts appear on training images as well?

Hi, do you have any suggestions? Thanks.

@windj007
Copy link
Collaborator

Honestly, I did not have time to think about your issue thoroughly.

A couple of questions:

  1. Could you please show training metrics from tensorboard? Especially discriminator scores and R1 gradient penalty, but others should be informative as well.
  2. Did you try changing coefficient for R1 gradient penalty?

@windj007
Copy link
Collaborator

windj007 commented Apr 8, 2022

I'm closing the issue for now. If you have any other questions, feel free to reopen it or create a new one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants