CrowdTruth had an appearance at the Watson Experience MeetUp last week. Together with Zoltán Szlávik, my colleague from IBM, we talked about the pervasive myths that still influence how we collect annotation from humans. While time and money constraints definitely influence data quality, the common core of all of these issues is rather the very definition of quality, as well as what the value of ambiguous data is. The slides of the talk were based on this paper.
Thank you to Jibes for organizing, Rabobank Utrecht for hosting us, and especially to Loes Brouwers and Tessa van der Eems for setting all of this up!