Provides utilities for the design and analysis of replication studies. Features both traditional methods based on statistical significance and more recent methods such as the sceptical p-value. Also provides related methods including the harmonic mean chi-squared test and intrinsic credibility. Contains datasets from four large-scale replication projects.
CRAN version:
install.packages("ReplicationSuccess")Development version from github with latest developments:
devtools::install_github(repo = "crsuzh/ReplicationSuccess")- Website (pkgdown): https://crsuzh.github.io/ReplicationSuccess/
- CRAN repository: https://cran.r-project.org/web/packages/ReplicationSuccess/
To access the vignette from R use:
library("ReplicationSuccess")
vignette("ReplicationSuccess")-
Held, L. (2019). The assessment of intrinsic credibility and a new argument for p < 0.005. Royal Society Open Science, 6(3):181534. https://doi.org/10.1098/rsos.181534
-
Held, L. (2020). A new standard for the analysis and design of replication studies (with discussion). Journal of the Royal Statistical Society: Series A (Statistics in Society). 183(2):431-448. https://doi.org/10.1111/rssa.12493
-
Held, L. (2020). The harmonic mean chi-squared test to substantiate scientific findings. Journal of the Royal Statistical Society: Series C (Applied Statistics). 69(3):697-708. https://doi.org/10.1111/rssc.12410
-
Pawel, S., Held, L. (2020). Probabilistic forecasting of replication studies. PLOS ONE. 15(4):e0231416. https://doi.org/10.1371/journal.pone.0231416
-
Micheloud, C., Held, L. (2021). Power Calculations for Replication Studies. Statistical Science. 37(3):369–379. https://doi.org/10.1214/21-STS828
-
Held, L., Micheloud, C., Pawel, S. (2022). The assessment of replication success based on relative effect size. The Annals of Applied Statistics. 16:706–720. https://doi.org/10.1214/21-AOAS1502
-
Micheloud, C., Balabdaoui, F., Held, L. (2023). Assessing replicability with the sceptical p-value: Type-I error control and sample size planning. Statistica Neerlandica. https://doi.org/10.1111/stan.12312
-
Held, L., Pawel, S., Micheloud, C. (2024). The assessment of replicability using the sum of p-values. Royal Society Open Science. 11(8):11240149. https://doi.org/10.1098/rsos.240149