Repeated judgment sampling: Boundaries
This paper investigates the boundaries of the recent result that eliciting more than one estimate from the same person and averaging these can lead to accuracy gains in judgment tasks. It first examines its generality, analysing whether the kind of question being asked has an effect on the size of potential gains. Experimental results show that the question type matters. Previous results reporting potential accuracy gains are reproduced for year-estimation questions, and extended to questions about percentage shares. On the other hand, no gains are found for general numerical questions. The second part of the paper tests repeated judgment sampling's practical applicability by asking judges to provide a third and final answer on the basis of their first two estimates. In an experiment, the majority of judges do not consistently average their first two answers. As a result, they do not realise the potential accuracy gains from averaging.
Year of publication: |
2011
|
---|---|
Authors: | Muller-Trede, Johannes |
Published in: |
Judgment and Decision Making. - Society for Judgment and Decision Making, ISSN 1930-2975. - Vol. 6.2011, 4, p. 283-294
|
Publisher: |
Society for Judgment and Decision Making |
Subject: | repeated judgments | judgment accuracy | averaging |
Saved in:
freely available
Saved in favorites
Similar items by subject
-
Kim, Kihwan, (2015)
-
Hallerbach, Winfried G., (2000)
-
Model averaging, asymptotic risk, and regressor groups
Hansen, Bruce E., (2014)
- More ...