Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pvrcnn result in pa-aug paper lower than original paper #1

Closed
turboxin opened this issue Oct 10, 2020 · 4 comments
Closed

pvrcnn result in pa-aug paper lower than original paper #1

turboxin opened this issue Oct 10, 2020 · 4 comments

Comments

@turboxin
Copy link

Hi @sky77764,thanks for sharing the code.

I have a question when reading the paper, moderate car val AP 3D@0.7 of pvrcnn is 84.84 in original pvrcnn paper and 83.61 in open-pcdet implementation, while in pa-aug paper is 80.43.
pa-aug

Why is it much lower than original paper or open-pcdet implementation.

@sky77764
Copy link
Owner

@turboxin Sorry for the confusing results.
We reported AP with 11 recall points but pvrcnn with 40.
The AP with 11 recall points is always lower than 40's.

@turboxin
Copy link
Author

Hi @sky77764, thanks for the quick reply!

I noticed that pvrcnn also report 11 recall points result which is 83.90
image

I'm wondering how do you get the 80.43 results since I couldn't find this in pvrcnn paper.

@turboxin
Copy link
Author

Sorry the figure in last reply wasn't uploaded successfuly.

pvrcnn

@sky77764
Copy link
Owner

Ah, it's right. I missed it.
캡처
These are the raw scores when I report results on the paper.
I only changed the batch size of the original OpenPCDet settings.

@sky77764 sky77764 closed this as completed Feb 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants