Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing file (crop_sub_images.py). #14

Closed
sunlustar opened this issue Jan 6, 2022 · 10 comments
Closed

Missing file (crop_sub_images.py). #14

sunlustar opened this issue Jan 6, 2022 · 10 comments

Comments

@sunlustar
Copy link

Thanks for your great work, but it seems to lack a related file (crop_sub_images.py) in this project for training. Could you upload this file? I would appreciate it.

@ckkelvinchan
Copy link
Owner

Sorry about that. I just added it.

@sunlustar
Copy link
Author

Thanks. But I have another problem when using distributed training.

image

And I have checked my data path, it is
├─ REDS
├── train_sharp_sub
├───-000_s001
├───-000_s002

And when I use the single GPU training strategy, there is another problem like,
image
It seems due to the dismatched batchsize dismension question between input and label, but I don't know why. The parameters in realbasicvsr_wogan_c64b20_2x30x8_lr1e-4_300k_reds.py keep same.

@ckkelvinchan
Copy link
Owner

If the training dataset path is correct, it seems that the validation set path is incorrect. Have you downloaded the UDM10 dataset for validation?

@sunlustar
Copy link
Author

Yes, you are right, I got a mistake with the validation set path. However, it turned to the dismatched batchsize dismension question when using both distributed training and single GPU training, have you ever meet this problem? Thanks.
image

@ckkelvinchan
Copy link
Owner

I did not encounter this error before.

I have no access to the GPU server at the moment. I will run again when I get back the access later today. For now, you can try printing out the input and output dimensions to check if there are any problems.

@sunyclj
Copy link

sunyclj commented Jan 11, 2022

@sunlustar Where was the UDM10 dataset downloaded? train_sharp_sub dataset is which of REDS? thanks. I don't find.
1641885447930_6C7A586C-CFC5-4e1b-BDCF-883B5C106EA3

@sunyclj
Copy link

sunyclj commented Jan 11, 2022 via email

@Ha0Tang
Copy link
Contributor

Ha0Tang commented Jan 16, 2022

@ckkelvinchan @sunlustar I also meet the error "ValueError: You may use too small dataset and our distributed sampler cannot pad your dataset correctly. We highly recommend you to use fewer GPUs to finish your work". How should I fix it?

@Ha0Tang
Copy link
Contributor

Ha0Tang commented Jan 16, 2022

And I have checked my data path, it is
├─ REDS
├── train_sharp_sub
├───-000_s001
├───-000_s002
├─ UDM10
├───-BIx4
├───---calendar
├───---city
├───---foliage
├───---walk
├───-GT
├───---calendar
├───---city
├───---foliage
├───---walk
├─ VideoLQ

am I missing something? @ckkelvinchan @sunlustar

@ckkelvinchan
Copy link
Owner

And I have checked my data path, it is ├─ REDS ├── train_sharp_sub ├───-000_s001 ├───-000_s002 ├─ UDM10 ├───-BIx4 ├───---calendar ├───---city ├───---foliage ├───---walk ├───-GT ├───---calendar ├───---city ├───---foliage ├───---walk ├─ VideoLQ

am I missing something? @ckkelvinchan @sunlustar

It seems that the folder UDM10 is not downloaded correctly. You are using Vid4.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants