Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Choose correct number of knots for GAMs #25

Closed
4 tasks
Aariq opened this issue May 15, 2024 · 3 comments
Closed
4 tasks

Choose correct number of knots for GAMs #25

Aariq opened this issue May 15, 2024 · 3 comments
Assignees

Comments

@Aariq
Copy link
Collaborator

Aariq commented May 15, 2024

Talked with @diazrenata and came up with the following ideas for getting the number of knots right:

  • (re-) read ?choose.k and do the thing where you look for patterns in the residuals
  • work with even more aggregated data to start with (for faster iteration)
  • Follow through to ultimate analysis (map of marginal slopes with non-significant areas greyed out) because if changes in k don't produce qualitative statistical changes, they probably don't matter much
  • possibly increase k more in the interaction term than in the main effects (maybe should ask someone if this is a legit thing to do though)

Originally posted by @Aariq in #23 (comment)

@Aariq
Copy link
Collaborator Author

Aariq commented May 28, 2024

Going to bump this to the next sprint in hopes that someone will share example code for the NCV paper (cct-datascience/organization#2091).

https://fosstodon.org/deck/@millerdl@mathstodon.xyz/112498626465593674

@Aariq
Copy link
Collaborator Author

Aariq commented Jun 7, 2024

So not sure what the "neighborhoods" are when NCV is applied to a raster dataset. Is it some area around every pixel? If so, that feels impractical. Going to do some reading about spatial CV:

Brenning, A., 2012. Spatial cross-validation and bootstrap for the assessment of prediction rules in remote sensing: The R package sperrorest, in: 2012 IEEE International Geoscience and Remote Sensing Symposium. Presented at the 2012 IEEE International Geoscience and Remote Sensing Symposium, pp. 5372–5375. https://doi.org/10.1109/IGARSS.2012.6352393

Le Rest, K., Pinaud, D., Monestiez, P., Chadoeuf, J., Bretagnolle, V., 2014. Spatial leave-one-out cross-validation for variable selection in the presence of spatial autocorrelation. Global Ecology and Biogeography 23, 811–820. https://doi.org/10.1111/geb.12161

@Aariq Aariq mentioned this issue Jun 12, 2024
5 tasks
@Aariq
Copy link
Collaborator Author

Aariq commented Jun 12, 2024

Going to close this for now as it has become more of a quest to get NCV working. Follow up in #30 includes "choose correct number of knots"

@Aariq Aariq closed this as completed Jun 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant