Resources for Reproducibility

In the fascinating world of reproducibility, there is always more. See below some selected resources and references used in creating the tutorials (updated March 2024).

1 Guides and tutorials on reproducibility

  • FORRT - Framework for Open and Reproducible Research (link)

  • Introduction to Reproducible Publications with RStudio (The Carpentries) (link)

  • Open Science Training Handbook (link)

  • Harrell F E: R Workflow for Reproducible Data Analysis and Reporting (link)

  • Bauer, P. C., & Landesvatter, C. (2023). Writing a reproducible paper with RStudio and quarto. (link)

  • Peikert, Aaron, & Diemerling, Hannes. (2023). Reproducible Research in R: A Workshop on How to Do the Same Thing More Than Once. Zenodo. https://doi.org/10.5281/zenodo.8069391

  • Peikert, A., van Lissa, C. J., & Brandmaier, A. M. (2021). Reproducible Research in R: A Tutorial on How to Do the Same Thing More Than Once. Psych, 3(4), Article 4. https://doi.org/10.3390/psych3040053

  • AEA Data Editor Guidance and tools (link)

2 Reproducibility checklists

  • Data and Code Availability Standard by AEA Social Science Data Editors: https://datacodestandard.org/

  • Reproducibility checklist by Meta-Psychology journal

  • Journal of Applied Psychology methods checklist 2022 (pdf link)

  • Wicherts, J. M., Veldkamp, C. L., Augusteijn, H. E., Bakker, M., Van Aert, R., & Van Assen, M. A. (2016). Degrees of freedom in planning, running, analyzing, and reporting psychological studies: A checklist to avoid p-hacking. Frontiers in psychology, 7, 222767. https://doi.org/10.3389/fpsyg.2016.01832

  • Lombaers, P., Bruin, J. de, & Schoot, R. van de. (2024). Reproducibility and Data storage Checklist for Active Learning-Aided Systematic Reviews. https://doi.org/10.31234/osf.io/g93zf

3 R packages used in the tutorials

  • Modelsummary - Creates tables and plots to present descriptive statistics and to summarize statistical models in R.

  • Flextable - a framework to easily create tables for reporting and publications.

  • Report - “From R to your manuscript”.

  • Gtsummary - Create publication-ready analytical and summary tables.

4 Tutorials for Mplus analyses in R

  • Garber, A. C. (2021). BCH Two-step Auxiliary Variable Integration with MplusAutomation. osf link
  • Garber, A. C. (2021). 3-Step ML Auxiliary Variable Integration Using MplusAutomation. osf link
  • Wardenaar, K. (2021). Latent Profile Analysis in R: A tutorial and comparison to Mplus.osf link