New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Shape and Texture biased pretrain models #2
Comments
Sure. I will check if I saved these models and get back to you. Please expect a little bit late response because I am catching a deadline next month. |
Thank you very much! That will be very helpful : )
…On Fri, Oct 23, 2020 at 13:04 Yingwei Li ***@***.***> wrote:
Sure. I will check if I saved these models and get back to you. Please
expect a little bit late response because I am catching a deadline next
month.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ALNH6PBFZQZRZGLSFVUWKBTSMHOU5ANCNFSM4S4ZXZ2Q>
.
|
Hi Yingwei~ In order to better schedule for my experiments, would you mind telling me what hardware you use to training the models? |
For the results on ImageNet, I use 8 Titan XP but it still takes a long period of time for training. At the early stage of this project, I use ResNet-18 with a downsampled ImageNet to quickly see some signals. |
Thank you very much for the quick reply!! |
It's me again :) Thank you for your patient and quick response! I wonder if you still remember how many days does it takes your to train a model (for ResNet50 or other models)? (A approximation will be just fine! So that I can have an estimate on my experiments.) |
It's been a while since I ran the training script, so I am not that sure. The training time might also be different if the hardware (e.g., #CPU, #GPU) is different. The training script prints a much accurate per-epoch time estimation, and then you could use that time to compute the total training time on your side. On my side, it takes about half a week for ResNet50, but, as again, it's been a while since I did experiments. If you want to speed up the training time, you can try to use DistributedDataParallel (instead of DataParallel) as the parallel strategy. |
Thank you very much for your advice and reply. It's very helpful and important to my future research!! : ) |
Hi LiYing, I had tried to train the texture/shape biased model with label-gamma = 0,1. |
As I mentioned in #1 , when you use a small training batch size, the learning rate should be accordingly small. Could you try to set train-batch as 256 or set lr as 0.025? I don't know if there are other issues to fix since the performance is too low. What dataset do you use for training? My script was: python imagenet.py -a resnet50 --data $DATA --epochs 100 --schedule 30 60 90 --gamma 0.1 --checkpoint $MODEL_DIR --gpu-id 0,1,2,3,4,5,6,7 -j 8 --train-batch 256 --lr 0.1 --num_classes 1000 --mixbn --style --alpha 0.5 --lr_schedule step --multi_grid --label-mix-alpha 1 --warm_lr 0. --warm 5 |
@LiYingwei I use ILSVRC2012-1k to train the model. |
@LiYingwei I can not find the parameter |
Should be |
Gotha! Thank you! : ) |
As promised, here are the Shape- and Texture-biased ResNet-50 models. |
Thanks, I'll check them out. I really appreciated it!
…On Tue, Nov 24, 2020 at 06:00 Yingwei Li ***@***.***> wrote:
As promised, here are the Shape- and Texture-biased ResNet-50 models.
res50-shape-biased.pth.tar
<https://livejohnshopkins-my.sharepoint.com/:u:/g/personal/yli286_jh_edu/Ece6w9LyQhBIizrJ7V1Jg20BqPp733hDaaBHSgJE9oN2IA?e=RnCUH1>
res50-texture-biased.pth.tar
<https://livejohnshopkins-my.sharepoint.com/:u:/g/personal/yli286_jh_edu/ETI0wwE_YTxOl8rIaJRI3rcBry1BuAbRfxTAO1guLy5Fcw?e=w3uLMB>
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#2 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ALNH6PDV5SQSHV62P6RLTU3SRO37XANCNFSM4S4ZXZ2Q>
.
|
Thank you for your exciting paper and nice script! I am interested in how the shape/texture biased model perform and would like to do some experiments on those biased models.
I wonder if you save shape/texture biased model (label-gamma=[1,0])? If possible, would you mind share a ResNet50 texture/shape biased pretrain model with me?
Thank you very much! : )
The text was updated successfully, but these errors were encountered: