Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about learning rate #53

Closed
Buffyqsf opened this issue Jan 10, 2024 · 2 comments
Closed

Questions about learning rate #53

Buffyqsf opened this issue Jan 10, 2024 · 2 comments
Labels
question Further information is requested

Comments

@Buffyqsf
Copy link

Why do you set learning rate to 0 in mapping stage, and , because the learning rate has been defined before (in the params groups), I don't seen the meaning of setting lr and eps.
屏幕截图 2024-01-10 151113

@Nik-V9
Copy link
Contributor

Nik-V9 commented Jan 10, 2024

Hi, you are right. The lr=0.0 doesn't come into effect here. I was following the same initialization code as the Dynamic 3D Gaussians code:
https://github.com/JonathonLuiten/Dynamic3DGaussians/blob/7dbbd4dec404308524ff402756bdb8143a2589b0/train.py#L76

By default, Adam has an eps value of 1e-8. I think the eps=1e-15 parameter does take effect. However, this is something I must further check.

@Nik-V9 Nik-V9 added the question Further information is requested label Jan 10, 2024
@Nik-V9
Copy link
Contributor

Nik-V9 commented Feb 3, 2024

Closing Issue due to inactivity.

@Nik-V9 Nik-V9 closed this as completed Feb 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants