Showing 1 - 10 of 34
Journals favor rejection of the null hypothesis. This selection upon tests may distort the behavior of researchers. Using 50,000 tests published between 2005 and 2011 in the AER, JPE, and QJE, we identify a residual in the distribution of tests that cannot be explained by selection. The...
Persistent link: https://www.econbiz.de/10010293191
The economics 'credibility revolution' has promoted the identification of causal relationships using difference-in-differences (DID), instrumental variables (IV), randomized control trials (RCT) and regression discontinuity design (RDD) methods. The extent to which a reader should trust claims...
Persistent link: https://www.econbiz.de/10011931761
This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. The analysis involves computational reproducibility checks and robustness assessments. It reveals several patterns. First, we...
Persistent link: https://www.econbiz.de/10014533953
Randomized controlled trials (RCTs) are increasingly prominent in economics, with pre-registration and pre-analysis plans (PAPs) promoted as important in ensuring the credibility of findings. We investigate whether these tools reduce the extent of p-hacking and publication bias by collecting and...
Persistent link: https://www.econbiz.de/10013342607
Amazon's Mechanical Turk is a very widely-used tool in business and economics research, but how trustworthy are results from well-published studies that use it? Analyzing the universe of hypotheses tested on the platform and published in leading journals between 2010 and 2020 we find evidence of...
Persistent link: https://www.econbiz.de/10013348127
Randomized controlled trials (RCTs) are increasingly prominent in economics, with pre-registration and pre-analysis plans (PAPs) promoted as important in ensuring the credibility of findings. We investigate whether these tools reduce the extent of p-hacking and publication bias by collecting and...
Persistent link: https://www.econbiz.de/10013426325
Amazon Mechanical Turk is a very widely-used tool in business and economics research, but how trustworthy are results from well-published studies that use it? Analyzing the universe of hypotheses tested on the platform and published in leading journals between 2010 and 2020 we find evidence of...
Persistent link: https://www.econbiz.de/10013426327
In this paper, we examine the relationship between p-hacking and data-sharing policies for published articles. We collect 38,876 test statistics from 1,106 articles published in leading economic journals between 2002–2020. While a data-sharing policy increases the provision of research data to...
Persistent link: https://www.econbiz.de/10013426435
Amazon's Mechanical Turk is a very widely-used tool in business and economics research, but how trustworthy are results from well-published studies that use it? Analyzing the universe of hypotheses tested on the platform and published in leading journals between 2010 and 2020 we find evidence of...
Persistent link: https://www.econbiz.de/10013443537
In this paper, we examine the relationship between p-hacking and datasharing policies for published articles. We collect 38,876 test statistics from 1,106 articles published in leading economic journals between 2002-2020. While a data-sharing policy increases the provision of research data to...
Persistent link: https://www.econbiz.de/10013480178