Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about step size training in LSQ and LSQ+. #12

Open
EthanLeong opened this issue Apr 12, 2023 · 0 comments
Open

Questions about step size training in LSQ and LSQ+. #12

EthanLeong opened this issue Apr 12, 2023 · 0 comments

Comments

@EthanLeong
Copy link

Thank you so much for your open source work!! This project really help me out a lot. I just have one question regarding LSQ and LSQ+. I hope I am not misunderstanding anything, but as far as I concern, the learned step size should be a scale value. However, during training, I noticed that there were times where the step size will become negative and the quantized performance of the model will become really bad. Is this some kinds of bug from the original paper or is it me who is making a huge mistake. Any help from you is appreciated, thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant