Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

between_within or ml1 df for post-hoc tests based on glmm #222

Open
InkaMarei opened this issue Feb 26, 2023 · 3 comments
Open

between_within or ml1 df for post-hoc tests based on glmm #222

InkaMarei opened this issue Feb 26, 2023 · 3 comments

Comments

@InkaMarei
Copy link

I have a question regarding the degrees of freedoms used in post-hoc tests in modelbased. The parameters package allows the selection of "betwithin" or "ml1" degrees of freedoms for GLMMs which seems the better choice than the residual degrees of freedoms or z-tests. However, I cannot find out how I can use those in subsequent post-hoc testing via modelbased (or emmeans).
Is that even possible? I would really value your response.

@bwiernik
Copy link
Contributor

I would recommend using profile or uniroot confidence intervals (eg, ci_method = "profile") rather than any DoF approximation. This is a much stronger theoretical foundation. If you really insist on a DoF approximation, they each have really important pros and cons and which is the best one to use will really depend on your model and data.

@strengejacke
Copy link
Member

I'm not sure you have this option for post-hoc tests. I think you can indeed "only" specify df's (but not 100% sure, though).

@InkaMarei
Copy link
Author

InkaMarei commented Feb 28, 2023

Hello, thank you very much for your responses! Maybe I understand something incorrectly, but even with profile-likelihood estimation (allows estimation of unsymmetric CIs of the final estimate), I still have the issue of increased type 1 error when I use residual dfs, or am I mistaken? Anyhow, the profile-likelihood option can to my knowledge also only be selected in the parameters package, and not in modelbased for post-hoc testing or in emmeans, right?
From my perspective, this problem with not being able to use an appropriate number of dfs in post-hoc testing after a GLMM is a major drawback of emmeans and modelbased. I am using R for regulatory purposes and am dependent on a proper estimation of dfs after GLMMs. Using GLMMs and following post-hoc tests is recommended in the new EFSA bird and mammal Guidance (https://efsa.onlinelibrary.wiley.com/doi/epdf/10.2903/j.efsa.2023.7790), and the EFSA draft honey bee Guidance (https://www.efsa.europa.eu/en/news/bees-and-pesticides-draft-guidance-update-public-consultation). Not being able to estimate the dfs for post-hoc testing after GLMMs is restriciting us to use R in regulatory ecotoxicology.
Is it possible to add this feature and maybe even think about implementing Kenward-Rogers df and satterthwaites dfs for GLMMs? It is possible in SAS (https://support.sas.com/documentation/cdl/en/statug/68162/HTML/default/viewer.htm#statug_glimmix_details40.htm) and it would be extremely helpful in R!

A possible solution would be that I could use the output from model_parameters(), along with the dfs from the ml1 method, in modelbased.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants