Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproducing on ped1&2 #18

Open
nono-zz opened this issue Mar 31, 2022 · 3 comments
Open

Reproducing on ped1&2 #18

nono-zz opened this issue Mar 31, 2022 · 3 comments

Comments

@nono-zz
Copy link

nono-zz commented Mar 31, 2022

Hi, thanks for presenting your great work.

I have a problem while reproducing the results on ped2 dataset, the AUC never reached 99% as mentioned in the paper. I got 97% after training, and after fine-tuning, AUC decreased to 95%. Also, it seems like the performance couldn't improve after the first epoch in training.

I strictly followed the preprocessing steps and didn't change the configurations you provided. Do you have any suggestions regarding this issue? And also, have you tested the model on ped1 dataset, I wonder if there're any configurations differ from ped2.

Thank you so much.

@nono-zz nono-zz changed the title Reproducing on ped2 Reproducing on ped1&2 Mar 31, 2022
@LiUzHiAn
Copy link
Owner

LiUzHiAn commented Apr 1, 2022

Hi, thanks for the interest.

I think you have extracted the needed spatial-temporal cubes for training. Could you first load our pre-trained model to see if you can get 99% AUC, in order to check the correctness of the preprocessing steps?

We found the flows are very important for the Ped2 dataset. If your preprocessing is the same as ours, I think you can play with the memory-augmented autoencoder first, trying to get a good reconstruction model. Then, you can go on to stick to the prediction model, and finetuning the hybrid pipeline together. As for the finetuning, we found it improves the final AUC a bit.

We didn't test on Ped1, the foreground objects are much denser, you can tune the object detection thresholds for this dataset. If have other questions, you can drop me an email via liuzhian98@qq.com since I may not be able to reply in time here.

@nono-zz
Copy link
Author

nono-zz commented Apr 1, 2022

Thank you so much for your reply, I'll check that.

@SHAOjav
Copy link

SHAOjav commented Jul 12, 2022

Hello This is very excellent work, I am following
I want to know how to get this type file (Test002_gt), because I don't find any code about this file.
hope to get your reply!
Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants