Task assignment optimization in collaborative crowdsourcing

Habibur Rahman, Senjuti Basu Roy, Saravanan Thirumuruganathan, Sihem Amer-Yahia, Gautam Das

Research output: Chapter in Book/Report/Conference proceedingConference contribution

18 Citations (Scopus)

Abstract

A number of emerging applications, such as, collaborative document editing, sentence translation, and citizen journalism require workers with complementary skills and expertise to form groups and collaborate on complex tasks. While existing research has investigated task assignment for knowledge intensive crowdsourcing, they often ignore the aspect of collaboration among workers, that is central to the success of such tasks. Research in behavioral psychology has indicated that large groups hinder successful collaboration. Taking that into consideration, our work is one of the first to investigate and formalize the notion of collaboration among workers and present theoretical analyses to understand the hardness of optimizing task assignment. We propose efficient approximation algorithms with provable theoretical guarantees and demonstrate the superiority of our algorithms through a comprehensive set of experiments using real-world and synthetic datasets. Finally, we conduct a real world collaborative sentence translation application using Amazon Mechanical Turk that we hope provides a template for evaluating collaborative crowdsourcing tasks in micro-task based crowdsourcing platforms.

Original languageEnglish
Title of host publicationProceedings - 15th IEEE International Conference on Data Mining, ICDM 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages949-954
Number of pages6
Volume2016-January
ISBN (Electronic)9781467395038
DOIs
Publication statusPublished - 5 Jan 2016
Externally publishedYes
Event15th IEEE International Conference on Data Mining, ICDM 2015 - Atlantic City, United States
Duration: 14 Nov 201517 Nov 2015

Other

Other15th IEEE International Conference on Data Mining, ICDM 2015
CountryUnited States
CityAtlantic City
Period14/11/1517/11/15

    Fingerprint

Keywords

  • Algorithms
  • Collaborative crowdsourcing
  • Crowdsourcing
  • Optimization

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Rahman, H., Roy, S. B., Thirumuruganathan, S., Amer-Yahia, S., & Das, G. (2016). Task assignment optimization in collaborative crowdsourcing. In Proceedings - 15th IEEE International Conference on Data Mining, ICDM 2015 (Vol. 2016-January, pp. 949-954). [7373417] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICDM.2015.119