“All Those Wasted Hours: On Task Abandonment in Crowdsourcing”

Authors: Lei Han, Kevin Roitero, Ujwal Kumar, Cristina Sarasua, Alessandro Checco, Eddy Maddalena, and Gianluca Demartini accepted as full paper at #WSDM2019 (16% acceptance).
We looked at crowd work which gets started and then abandoned thus being unrewarded. In our large-scale experiment, the total effort invested by abandoning workers accounts for 616 hours of work which are equivalent to about 3.5 months FTE!