Research Repository

Events data as bismarck's sausages? intercoder reliability, coders' selection, and data quality

Ruggeri, A and Gizelis, TI and Dorussen, H (2011) 'Events data as bismarck's sausages? intercoder reliability, coders' selection, and data quality.' International Interactions, 37 (3). 340 - 361. ISSN 0305-0629

Full text not available from this repository.

Abstract

Precise measurement is difficult but essential in the generation of high-quality data, and it is therefore remarkable that often so little attention is paid to intercoder reliability. It is commonly recognized that poor validity leads to systematic errors and biased inference. In contrast, low reliability is generally assumed to be a lesser concern, leading only to random errors and inefficiency. We evaluate the intercoder reliability of our recently collected data on governance events in UN peacekeeping and show how poor coding and low intercoder reliability can produce systematic errors and even biased inference. We also show how intercoder reliability checks are useful to improve data quality. Continuous testing for intercoder reliability ex post enables researchers to create better data and ultimately improves the quality of their analyses. © Taylor & Francis Group, LLC.

Item Type: Article
Subjects: J Political Science > JA Political science (General)
Divisions: Faculty of Social Sciences > Government, Department of
Depositing User: Jim Jamieson
Date Deposited: 12 Sep 2013 20:39
Last Modified: 23 Jan 2019 00:15
URI: http://repository.essex.ac.uk/id/eprint/7543

Actions (login required)

View Item View Item