The Dangers of Extreme Counterfactuals
We address the problem that occurs when inferences about counterfactuals -- predictions, quot;what ifquot; questions, and causal effects -- are attempted far from the available data. The danger of these extreme counterfactuals is that substantive conclusions drawn from statistical models that fit the data well turn out to be based largely on speculation hidden in convenient modeling assumptions that few would be willing to defend. Yet existing statistical strategies provide few reliable means of identifying extreme counterfactuals. We offer a proof that inferences farther from the data are more model-dependent, and then develop easy-to-apply methods to evaluate how model-dependent our answers would be to specified counterfactuals. These methods require neither sensitivity testing over specified classes of models nor evaluating any specific modeling assumptions. If an analysis fails the simple tests we offer, then we know that substantive results are sensitive to at least some modeling choices that are not based on empirical evidence
Year of publication: |
[2008]
|
---|---|
Authors: | King, Gary |
Other Persons: | Zeng, Langche (contributor) |
Publisher: |
[2008]: [S.l.] : SSRN |
Saved in:
freely available
Saved in favorites
Similar items by person
-
When Can History be Our Guide? The Pitfalls of Counterfactual Inference
King, Gary, (2007)
-
Estimating Risk and Rate Levels, Ratios and Differencesin Case-Control Studies
King, Gary, (2002)
-
Empirical Versus Theoretical Claims About Extreme Counterfactuals : A Response
King, Gary, (2010)
- More ...