We argue that comprehensive out-of-sample (OOS) evaluation using statistical decision theory (SDT) should replace the current practice of K-fold and Common Task Framework validation in machine learning (ML) research. SDT provides a formal framework for performing comprehensive OOS evaluation...

We study newsworthiness in theory and practice. We focus on situations in which a news outlet observes the realization of a state of the world and must decide whether to report the realization to a consumer who pays an opportunity cost to consume the report. The consumer-optimal reporting...

In medical treatment and elsewhere, it has become standard to base treatment intensity (dosage) on evidence in randomized trials. Yet it has been rare to study how outcomes vary with dosage. In trials to obtain drug approval, the norm has been to specify some dose of a new drug and compare it...

Empirical researchers frequently rely on normal approximations in order to summarize and communicate uncertainty about their findings to their scientific audience. When such approximations are unreliable, they can lead the audience to make misguided decisions. We propose to measure the failure...

While linking records across large administrative datasets ["big data"] has the potential to revolutionize empirical social science research, many administrative data files do not have common identifiers and are thus not designed to be linked to others. To address this problem, researchers have...

This paper introduces a simulation algorithm for evaluating the log-likelihood function of a large supermodular binary-action game. Covered examples include (certain types of) peer effect, technology adoption, strategic network formation, and multi-market entry games. More generally, the...

We propose a statistical model of differences in beliefs in which heterogeneous investors are represented as different machine learning model specifications. Each investor forms return forecasts from their own specific model using data inputs that are available to all investors. We measure...

The United States spends twice as much per person on pharmaceuticals as European countries, in large part because prices are much higher in the US. This fact has led policymakers to consider legislation for price controls. This paper assesses the effects of a US international reference pricing...

We examine the effect of enforcing minimum quality standards (MQSs) on consumer health. In the late 1800s, the urban milk supply was regularly skimmed and diluted with water, but consumers could not easily determine its quality because dyes, caramel, and salt were added. To protect consumers,...

The Covid-19 pandemic has brought renewed attention to rationing guidelines for scarce medical resources. This paper describes the benefits of using a reserve system over a priority system in operationalizing compromises between certain ethical goals. In the last two years, more than a dozen...