The emergence of online labor markets makes it far easier to use individual human raters to evaluate materials for data collection and analysis in the social sciences. In this paper, we report the results of an experiment - conducted in an online labor market - that measured the effectiveness of...

There is a growing literature measuring research excellence in economics. The h-index is noteworthy in combining quantity and research quality in a single measure of researcher excellence, and its ability to be extended to measure the quantity and quality of the researchers in a department. We...