Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Anyone train and test on Caltech dataset? #9

Open
msha096 opened this issue Nov 15, 2019 · 12 comments
Open

Anyone train and test on Caltech dataset? #9

msha096 opened this issue Nov 15, 2019 · 12 comments

Comments

@msha096
Copy link

msha096 commented Nov 15, 2019

Hi,

Is there anyone train and test on Caltech dataset? My model's MR is around 8-9% however the Keras's version's MR is around 4%. No idea why the MR is not promising. (I did not hybrid the data like Keras, is that the reason??)

Any suggestion?

@Yorionice1
Copy link

I have trained on caltech, but I can't reproduce the paper's number, my miss rate is 7.4%

@msha096
Copy link
Author

msha096 commented Dec 28, 2019

I have trained on caltech, but I can't reproduce the paper's number, my miss rate is 7.4%

I have the same situation and I am working to find out the reason why the behavior is disappointing on the Caltech dataset. (PyTorch code has a slightly better result on CityPersons dataset than TF)

Do you have any idea? I have tried the data hybrid, which is the method that the author of CSP takes in his TF code. However, the MR is still around 8%.

@msha096
Copy link
Author

msha096 commented Dec 28, 2019

@lw396285v Would you like to have a look at it? I have been working on this for about a month. I still have no progress. I have tried to use the same normalization, data hybrid and the MR is always around 8-9%.

@Yorionice1
Copy link

If I don't use the training methods in the paper,and let the lr decay to 0.00002 after 50 epochs, the MR is around 5.5%

@msha096
Copy link
Author

msha096 commented Jan 3, 2020

If I don't use the training methods in the paper,and let the lr decay to 0.00002 after 50 epochs, the MR is around 5.5%

what is the batchsize? did you change other configurations besides the train image size and the test image size when you switch from CityPersons to Caltech?

@Yorionice1
Copy link

BS==8 on caltech. image size is the same as in the paper.

@msha096
Copy link
Author

msha096 commented Jan 4, 2020

BS==8 on caltech. image size is the same as in the paper.

Can you share your train code please? It’s weird I am using bs=12 but
achieved a worse result. My email is msha096@uottawa.ca
Thanks and regards.

@LewX
Copy link

LewX commented Jan 9, 2020

@msha096 Hi, what's your training config?

@msha096
Copy link
Author

msha096 commented Jan 9, 2020

@msha096 Hi, what's your training config?

the same as Keras's one.

@LewX
Copy link

LewX commented Jan 10, 2020

@msha096 Hi, what's your training config?

the same as Keras's one.

Can you share your training strategy? thx

@fyture
Copy link

fyture commented Jul 28, 2020

hi, would you share me with the caltech code, thanks a lot! 408261278@qq.com

@s775980299
Copy link

I have trained on caltech, but I can't reproduce the paper's number, my miss rate is 7.4%

请问你是怎么复现的,我这里在编译setup.py文件一种报错,如果可以的话加一下我联系方式775980299,这个问题让我心烦好久了,非常感谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants