Research Repository

When Experts Disagree: Response Aggregation and Its Consequences in Expert Surveys

Lindstädt, René and Proksch, Sven-Oliver and Slapin, Jonathan (2018) 'When Experts Disagree: Response Aggregation and Its Consequences in Expert Surveys.' Political Science Research and Methods. ISSN 2049-8470

Expert_Survey_PSRM-for essex rep.pdf - Accepted Version

Download (214kB) | Preview


Political scientists use expert surveys to assess latent features of political actors. Experts, though, are unlikely to be equally informed and assess all actors equally well. The literature acknowledges variance in measurement quality, but pays little attention to the implications of uncertainty for aggregating responses. We discuss the nature of the measurement problem in expert surveys. We then propose methods to assess the ability of experts to judge where actors stand and to aggregate expert responses. We examine the effects of aggregation for a prominent survey in the literature on party politics and EU integration. Using a Monte Carlo simulation, we demonstrate that it is better to aggregate expert responses using the median or modal response, rather than the mean.

Item Type: Article
Uncontrolled Keywords: Expert Surveys, Measurement, Party Positions
Subjects: J Political Science > JA Political science (General)
Divisions: Faculty of Social Sciences > Government, Department of
Depositing User: Elements
Date Deposited: 24 Sep 2018 09:24
Last Modified: 29 Nov 2018 15:21

Actions (login required)

View Item View Item