Ruggeri, Andrea and Gizelis, Theodora-Ismene and Dorussen, Han (2011) Events Data as Bismarck's Sausages? Intercoder Reliability, Coders' Selection, and Data Quality. International Interactions, 37 (3). pp. 340-361. DOI https://doi.org/10.1080/03050629.2011.596028
Ruggeri, Andrea and Gizelis, Theodora-Ismene and Dorussen, Han (2011) Events Data as Bismarck's Sausages? Intercoder Reliability, Coders' Selection, and Data Quality. International Interactions, 37 (3). pp. 340-361. DOI https://doi.org/10.1080/03050629.2011.596028
Ruggeri, Andrea and Gizelis, Theodora-Ismene and Dorussen, Han (2011) Events Data as Bismarck's Sausages? Intercoder Reliability, Coders' Selection, and Data Quality. International Interactions, 37 (3). pp. 340-361. DOI https://doi.org/10.1080/03050629.2011.596028
Abstract
Precise measurement is difficult but essential in the generation of high-quality data, and it is therefore remarkable that often so little attention is paid to intercoder reliability. It is commonly recognized that poor validity leads to systematic errors and biased inference. In contrast, low reliability is generally assumed to be a lesser concern, leading only to random errors and inefficiency. We evaluate the intercoder reliability of our recently collected data on governance events in UN peacekeeping and show how poor coding and low intercoder reliability can produce systematic errors and even biased inference. We also show how intercoder reliability checks are useful to improve data quality. Continuous testing for intercoder reliability ex post enables researchers to create better data and ultimately improves the quality of their analyses. © Taylor & Francis Group, LLC.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | coders; events data; measurement; peacekeeping; reliability |
Subjects: | J Political Science > JA Political science (General) |
Divisions: | Faculty of Social Sciences Faculty of Social Sciences > Government, Department of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 12 Sep 2013 20:39 |
Last Modified: | 30 Oct 2024 20:33 |
URI: | http://repository.essex.ac.uk/id/eprint/7543 |