Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

External validation of fits in unit test #47

Open
4 tasks
lindeloev opened this issue Nov 5, 2019 · 0 comments
Open
4 tasks

External validation of fits in unit test #47

lindeloev opened this issue Nov 5, 2019 · 0 comments
Labels
enhancement New feature or request

Comments

@lindeloev
Copy link
Owner

Test accuracy of fits:

  • Add strong priors so that parameter estimates are (should be) altered considerably.
  • Validate parameter recovery in one-segment models against rstanarm, and loo and waic too.
  • Validate parameter recovery in multi-segment models by letting rstanarm or lme4 fit individual segments and compare fits. If reasonably vague priors and reasonably well-defined change points are used, they should be practically identical.
  • Plots: Check out the vdiffr package which ggplot2 uses.
@lindeloev lindeloev added the enhancement New feature or request label Nov 5, 2019
@lindeloev lindeloev added this to the 0.2 families and priors milestone Nov 5, 2019
@lindeloev lindeloev removed this from the 0.3 Generalize functionality milestone Jul 24, 2020
@lindeloev lindeloev changed the title Unit test of fits External validation of fits in unit test Feb 24, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@lindeloev