Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Errors included in the process of assigning the Position embedding vector for multi-head self attention #50

Closed
junhyung-SPALab opened this issue Aug 14, 2023 · 2 comments
Labels
bug Something isn't working

Comments

@junhyung-SPALab
Copy link

Thanks for your work. In the process of studying your great open source, I leave a question.

There seems to be a bug in the process of using the position embedding vector in the operation of the DSVT Block.

It seems that the position embedding vector required for Attention is assigned incorrectly.

The questions have been summarized in the image below.
//////////////////////////////////////////////////////////////////
This is an example of a case where DSVT is composed of one stage and each stage is designed with two blocks.
bug_0

bug_1 //////////////////////////////////////////////////////////////////

Thanks.

@chenshi3 chenshi3 added the bug Something isn't working label Aug 14, 2023
@chenshi3
Copy link
Collaborator

Thank you for raising this issue! We have also identified this bug and documented it in OpenPCDet. The reported results were obtained from this version, and we have chosen not to rectify the bug in the code. Furthermore, I attempted to address this bug but noticed negligible performance enhancements. I will make a note of this bug in the Readme for clarity.

@junhyung-SPALab
Copy link
Author

Thanks for confirming my issue. I think your README update will be helpful to other researchers in the future.

@Haiyang-W Haiyang-W pinned this issue Aug 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants