LOT Winter School 2019

Effect sizes and meta-analyses: Tools for cumulative, robust experimental science

Christina Bergmann

Contact

Email address: christina.bergmann@mpi.nl

Website teacher: http://www.mpi.nl/people/bergmann-christina





Title of the course: Effect sizes and meta-analyses: Tools for cumulative, robust experimental science

Teacher: Christina Bergmann

Course information
Level: advanced

Course description:

Single studies have long been the norm in experimental sciences to establish “facts” about the world, with little regard for cumulative thinking and reproducibility of the reported effects. This is problematic because our statistical tools are never completely conclusive. One consequence is that results frequently cannot be replicated, either because the effect is smaller than reported or because it simply is not present in the general population. Cumulative science, i.e. considering multiple studies together to get a better idea of what might be true, is one answer to this problem.

This course will give an introduction to tools of cumulative science: effect sizes and meta-analytic methods, including how to determine sample sizes before running a study and making informed design choices. Attendees are expected to have basic knowledge of the R statistical programming language and of standard frequentist statistical tests (t-tests, correlations, linear models).

Day-to-day program

Monday:

Why cumulative science matters: Reproducibility, replicability, and robust science.

Tuesday:

Theoretical introduction to effect sizes and meta-analyses, and how to consider replicability from the start.

Wednesday:

Practical introduction to conducting reproducible meta-analyses 1: Systematic literature review, computing effect sizes from different reported statistics.

Thursday:

Practical introduction to conducting reproducible meta-analyses 2: Meta-analytic models, interpreting the output, conducting moderator analyses.

https://doi.org/10.1177/0956797613504966

https://doi.org/10.1177/0956797611417632

https://doi.org/10.1111/infa.12182

https://doi.org/10.1111/infa.12078

https://doi.org/10.3389/fpsyg.2013.00863

https://osf.io/ixgcd/

https://www.r-project.org/
https://www.rstudio.com/products/rstudio/download/

https://doi.org/10.1177/1745691614552498

https://doi.org/10.1111/cdev.13079

http://www.prisma-statement.org/