Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A question about the experiment result. #2

Closed
lileicv opened this issue Dec 15, 2021 · 1 comment
Closed

A question about the experiment result. #2

lileicv opened this issue Dec 15, 2021 · 1 comment

Comments

@lileicv
Copy link

lileicv commented Dec 15, 2021

When I run the command

python train.py --dataset cmnist --exp=cmnist_0.5_ours --lr=0.01 --percent=0.5pct --curr_step=10000 --lambda_swap=1 --lambda_dis_align=10 --lambda_swap_align=10 --use_lr_decay --lr_decay_step=10000 --lr_gamma=0.5 --train_ours --tensorboard

the output is

...
valid_d: 0.11319999396800995 || test_d: 0.11349999904632568 
 97%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████▌   | 48496/50000 [12:32<00:16, 88.77it/s
48500 model saved ...                                                                                                                                         
valid_d: 0.11319999396800995 || test_d: 0.11349999904632568 
 98%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████▋  | 48996/50000 [12:40<00:10, 96.10it/s]
49000 model saved ...
                                                                                                                                                            
49000 model saved ...                                                                                                                                         
valid_d: 0.11319999396800995 || test_d: 0.11349999904632568 
 99%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████▊ | 49500/50000 [12:49<00:07, 71.10it/s
49500 model saved ...                                                                                                                                         
valid_d: 0.11319999396800995 || test_d: 0.11349999904632568 

The test acc is 0.1135. However in the paper, the result is 65.22. I don't know what's wrong. Can anyone help me?

@lileicv
Copy link
Author

lileicv commented Dec 15, 2021

When I modified the PyTorch version, this problem disappeared.

@lileicv lileicv closed this as completed Dec 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant