This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. The analysis involves computational reproducibility checks and robustness assessments. It reveals several patterns. First, we...

Overall, the results of this study are replicable using the clean dataset provided by the authors. However, the process of transforming the raw data into this clean dataset is at times unclear, and certain essential codes are missing from the replication materials, which may hinder complete...

We estimate the robustness reproducibility of key results from 17 non-experimental AER papers published in 2013 (8 papers) and 2022/23 (9 papers). We find that many of the results are not robust, with no improvement over time. The fraction of significant robustness tests (p﹤0.05) varies...

Berger, Easterly, Nunn and Satyanath (2013) find that increased US political influence, arising from Cold War interventions, was used to create a larger export market for American products. They find that after CIA interventions, US imports increased dramatically, and the authors rule out other...

Aghion, Van Reenen and Zingales (2013) find that institutional ownership causes an increase in innovation as measured by citation-weighted patent counts. To identify a causal effect, they use membership in the S&P 500 as an instrument for institutional ownership in a panel regression. We first...

Pop-Eleches and Urquiola (2013) apply a regression discontinuity to the Romanian secondary school system, and notably find that (a) students who go to a better school get higher scores on an exam used for university admission, (b) parents of students who get into a better school help their kids...

Cloyne (2013) constructs a novel dataset documenting fiscal tax shocks in the United Kingdom using the narrative approach developed by Romer and Romer (2010), and estimates the impact of tax changes on GDP. He finds that a tax cut of one percent of GDP causes a 0.6 percent increase in output in...

Naidu and Yuchtman (2013) find that labor demand shocks in 19th-century Britain had an impact on master and servant prosecutions, as breaking an employee contract was a criminal offense until 1875. We first reproduce all regression tables in Naidu and Yuchtman (2013) and then test for robustness...

Amazon's Mechanical Turk is a very widely-used tool in business and economics research, but how trustworthy are results from well-published studies that use it? Analyzing the universe of hypotheses tested on the platform and published in leading journals between 2010 and 2020 we find evidence of...

We use unique data from journal submissions to identify and unpack publication bias and p-hacking. We find that initial submissions display significant bunching, suggesting the distribution among published statistics cannot be fully attributed to a publication bias in peer review. Desk-rejected...