Is Quality Control Pointless?

Tools

Krause, Markus, Afzali, Farhad Mohammad, Caton, Simon and Hall, Margeret (2019) Is Quality Control Pointless? In: Proceedings of the 52nd Hawaii International Conference on System Sciences 2019. University of Hawai'i at Manoa, pp. 5279-5288. ISBN 9780998133126

[thumbnail of Is quality control pointless.pdf]

Preview

PDF
Available under License Creative Commons Attribution Non-commercial No Derivatives.
Download (598kB) | Preview

Official URL: http://hdl.handle.net/10125/59964

Abstract

Intrinsic to the transition towards, and necessary for the success of digital platforms as a service (at scale) is the notion of human computation. Going beyond ‘the wisdom of the crowd’, human computation is the engine that powers platforms and services that are now ubiquitous like Duolingo and Wikipedia. In spite of increasing research and population interest, several issues remain open and in debate on large-scale human computation projects. Quality control is first among these discussions. We conducted an experiment with three different tasks of varying complexity and five different methods to distinguish and protect against constantly underperforming contributors. We illustrate that minimal quality control is enough to repel constantly underperforming contributors and that this is constant across tasks of varying complexity.

Item Type:	Book Section
Subjects:	Q Science > QA Mathematics > Electronic computers. Computer science T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science
Divisions:	School of Computing > Staff Research and Publications
Depositing User:	Caoimhe Ní Mhaicín
Date Deposited:	11 Oct 2018 14:48
Last Modified:	04 Jan 2019 11:13
URI:	https://norma.ncirl.ie/id/eprint/3260

Actions (login required)

View Item