Workshop "A practical primer on transparent research workflows"
Psychological science is facing a crisis of confidence fueled by concerns about replicability of empirical findings (e.g., Open Science Collaboration, 2015). In response, psychologists have been reviewing how they do research and are leading many initiatives to improve replicability. A fundamental element is greater transparency and intersubjective verifiability: Researchers increasingly publish research materials, data and analysis scripts, publicly preregister their studies, and share and discuss preprints. The evolving open science ecosystem provides a variety of tools and services to help researchers adopt transparent research practices. However, setting up a transparent research workflow involves a plethora of decisions that can be off-putting. Fortunately, transparent research practices can be adopted piecemeal---each incremental step adds positive value for individual researchers and the credibility of psychological research. This active workshop will walk participants through the process of preparing and sharing their research products, including materials, data, analysis scripts, and study protocols. It will address what, when, and how to share and help participants develop transparent, less error-prone, and more reproducible research workflows.
Materials are based on Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Hofelich Mohr, A., … Frank, M. C. (2018). A Practical Guide for Transparency in Psychological Science. Collabra: Psychology, 4(1). doi: 10.1525/collabra.158 (Supplementary material)
Example project stimulus images courtesy of Michael J. Tarr, Center for the Neural Basis of Cognition and Department of Psychology, Carnegie Mellon University, http://www.tarrlab.org/. Funding provided by NSF award 0339122. CC-BY-NC-SA 3.0