Causes of and remedies for poor reproducibility (review draft)
1. Introduction
Over the past decade, large-scale replication projects in several fields have found that a substantial share of published findings cannot be independently reproduced, a phenomenon known as the replication crisis. This review examines its causes and compares the conditions under which existing remedies apply.
2. Causes
Whether a finding holds depends on a study's statistical power and degree of bias. The smaller the samples and effect sizes, and the more relationships tested with less preselection, the less likely a finding is to be true (Ioannidis, 2005). Researchers' flexibility in analysis further inflates false positives.
3. Remedies
Methodologically, preregistering study designs and analysis plans reduces post hoc choices (Munafò et al., 2017); for data, FAIR stewardship makes data findable, accessible, interoperable and reusable (Wilkinson et al., 2016).
To write: compare how well each remedy works across fields.