Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible Numerical Instability in Gaussian Mixture #1

Closed
andrewdalpino opened this issue Oct 25, 2018 · 1 comment
Closed

Possible Numerical Instability in Gaussian Mixture #1

andrewdalpino opened this issue Oct 25, 2018 · 1 comment
Assignees
Labels
enhancement New feature or request
Projects

Comments

@andrewdalpino
Copy link
Member

The current implementation of Gaussian Mixture clusterer uses probabilities directly instead of taking the log as is a convention used in other Gaussian/probability-based estimators in Rubix. When computing probabilities, numerical instability issues arise when such probabilities are very high or (more commonly) very low. By entering log space, we push the precision of the floating point number from the exponent to the mantissa, which has more precision and therefore avoids numerical under/overflows.

@andrewdalpino andrewdalpino added the enhancement New feature or request label Oct 25, 2018
@andrewdalpino andrewdalpino self-assigned this Oct 25, 2018
@andrewdalpino andrewdalpino added this to Backlog in Roadmap via automation Oct 29, 2018
@andrewdalpino andrewdalpino moved this from Backlog to In progress in Roadmap Dec 24, 2018
@andrewdalpino andrewdalpino moved this from In progress to Review in Roadmap Dec 24, 2018
@andrewdalpino andrewdalpino moved this from Review to Completed in Roadmap Dec 24, 2018
@andrewdalpino
Copy link
Member Author

Improved numerical stability with log probabilities

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
No open projects
Roadmap
  
Completed
Development

No branches or pull requests

1 participant