The Robustness Reproducibility of the American Economic Review
We estimate the robustness reproducibility of key results from 17 non-experimental AER papers published in 2013 (8 papers) and 2022/23 (9 papers). We find that many of the results are not robust, with no improvement over time. The fraction of significant robustness tests (p﹤0.05) varies between 17% and 88% across the papers with a mean of 46%. The mean relative t/z-value of the robustness tests varies between 35% and 87% with a mean of 63%, suggesting selective reporting of analytical specifications that exaggerate statistical significance. A sample of economists (n=359) overestimates robustness reproducibility, but predictions are correlated with observed reproducibility.
Year of publication: |
2024
|
---|---|
Authors: | Campbell, Douglas ; Brodeur, Abel ; Dreber, Anna ; Johannesson, Magnus ; Kopecky, Joseph ; Lusher, Lester ; Tsoy, Nikita |
Publisher: |
s.l. : Institute for Replication (I4R) |
Saved in:
freely available
Saved in favorites
Similar items by person
-
Campbell, Douglas, (2024)
-
Campbell, Douglas, (2024)
-
Campbell, Douglas, (2024)
- More ...