Skip to content

Convergence tweaks for reversible MLE and sampler#45

Merged
franknoe merged 1 commit intodevelfrom
rev_mle_convergence_tweaks
Aug 4, 2015
Merged

Convergence tweaks for reversible MLE and sampler#45
franknoe merged 1 commit intodevelfrom
rev_mle_convergence_tweaks

Conversation

@franknoe
Copy link
Copy Markdown
Contributor

@franknoe franknoe commented Aug 4, 2015

Affects mainly estimation: reversible tmatrix MLE and sampler:

  • Added option to suppress the not-converged warning.
  • Using that option and running only 100 steps in the initialization of the reversible transition matrix sampler. That's sufficient for the sampler because the MLE is just a starting point anyway. In cases where the reversible MLE doesn't converge well - and that seems to happen often for the fractional counts employed in Bayesian methods - we would otherwise optimize for 1M steps, just to throw that result away in the first sampling step. This change makes a huge performance difference for the Bayesian HMM, where a transition matrix sampling is run for every iteration of the algorithm (usually 100 times or more).

…press the not-converged warning. Using that option and running only 100 steps in the initialization of the reversible transition matrix sampler. That's sufficient for the sampler because the MLE is just a starting point anyway. In cases where the reversible MLE doesn't converge well - and that seems to happen often for the fractional counts employed in Bayesian methods - we would otherwise optimize for 1M steps, just to throw that result away in the first sampling step. This change makes a huge performance difference for the Bayesian HMM, where a transition matrix sampling is run for every iteration of the algorithm (usually 100 times or more).
franknoe added a commit that referenced this pull request Aug 4, 2015
Convergence tweaks for reversible MLE and sampler
@franknoe franknoe merged commit b1c6ecd into devel Aug 4, 2015
@franknoe franknoe deleted the rev_mle_convergence_tweaks branch August 4, 2015 18:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant