Chamberlain, Jon and Kruschwitz, Udo and Poesio, Massimo (2018) Optimising crowdsourcing efficiency: Amplifying human computation with validation. it - Information Technology, 60 (1). pp. 41-49. DOI https://doi.org/10.1515/itit-2017-0020
Chamberlain, Jon and Kruschwitz, Udo and Poesio, Massimo (2018) Optimising crowdsourcing efficiency: Amplifying human computation with validation. it - Information Technology, 60 (1). pp. 41-49. DOI https://doi.org/10.1515/itit-2017-0020
Chamberlain, Jon and Kruschwitz, Udo and Poesio, Massimo (2018) Optimising crowdsourcing efficiency: Amplifying human computation with validation. it - Information Technology, 60 (1). pp. 41-49. DOI https://doi.org/10.1515/itit-2017-0020
Abstract
Crowdsourcing has revolutionised the way tasks can be completed but the process is frequently inefficient, costing practitioners time and money. This research investigates whether crowdsourcing can be optimised with a validation process, as measured by four criteria: quality; cost; noise; and speed. A validation model is described, simulated and tested on real data from an online crowdsourcing game to collect data about human language. Results show that by adding an agreement validation (or a like/upvote) step fewer annotations are required, noise and collection time are reduced and quality may be improved.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Crowdsourcing; Empirical studies in interaction design; Interactive games; Social networks; Natural language processing |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 14 Sep 2018 16:02 |
Last Modified: | 30 Oct 2024 20:04 |
URI: | http://repository.essex.ac.uk/id/eprint/21626 |
Available files
Filename: Chamberlain2018Optimising_preprint.pdf