Task assignment optimization in knowledge-intensive crowdsourcing

Senjuti Basu Roy, Ioanna Lykourentzou, Saravanan Thirumuruganathan, Sihem Amer-Yahia, Gautam Das

Research output: Contribution to journalArticle

51 Citations (Scopus)

Abstract

We present SmartCrowd, a framework for optimizing task assignment in knowledge-intensive crowdsourcing (KI-C). SmartCrowd distinguishes itself by formulating, for the first time, the problem of worker-to-task assignment in KI-C as an optimization problem, by proposing efficient adaptive algorithms to solve it and by accounting for human factors, such as worker expertise, wage requirements, and availability inside the optimization process. We present rigorous theoretical analyses of the task assignment optimization problem and propose optimal and approximation algorithms with guarantees, which rely on index pre-computation and adaptive maintenance. We perform extensive performance and quality experiments using real and synthetic data to demonstrate that the SmartCrowd approach is necessary to achieve efficient task assignments of high-quality under guaranteed cost budget.

Original languageEnglish
Pages (from-to)467-491
Number of pages25
JournalVLDB Journal
Volume24
Issue number4
DOIs
Publication statusPublished - 24 Aug 2015
Externally publishedYes

Fingerprint

Wages
Approximation algorithms
Human engineering
Adaptive algorithms
Availability
Costs
Experiments

Keywords

  • Collaborative crowdsourcing
  • Human factors
  • Knowledge-intensive crowdsourcing
  • Optimization

ASJC Scopus subject areas

  • Information Systems
  • Hardware and Architecture

Cite this

Task assignment optimization in knowledge-intensive crowdsourcing. / Basu Roy, Senjuti; Lykourentzou, Ioanna; Thirumuruganathan, Saravanan; Amer-Yahia, Sihem; Das, Gautam.

In: VLDB Journal, Vol. 24, No. 4, 24.08.2015, p. 467-491.

Research output: Contribution to journalArticle

Basu Roy, S, Lykourentzou, I, Thirumuruganathan, S, Amer-Yahia, S & Das, G 2015, 'Task assignment optimization in knowledge-intensive crowdsourcing', VLDB Journal, vol. 24, no. 4, pp. 467-491. https://doi.org/10.1007/s00778-015-0385-2
Basu Roy, Senjuti ; Lykourentzou, Ioanna ; Thirumuruganathan, Saravanan ; Amer-Yahia, Sihem ; Das, Gautam. / Task assignment optimization in knowledge-intensive crowdsourcing. In: VLDB Journal. 2015 ; Vol. 24, No. 4. pp. 467-491.
@article{1840ef41b6a64855b9b185fca776545b,
title = "Task assignment optimization in knowledge-intensive crowdsourcing",
abstract = "We present SmartCrowd, a framework for optimizing task assignment in knowledge-intensive crowdsourcing (KI-C). SmartCrowd distinguishes itself by formulating, for the first time, the problem of worker-to-task assignment in KI-C as an optimization problem, by proposing efficient adaptive algorithms to solve it and by accounting for human factors, such as worker expertise, wage requirements, and availability inside the optimization process. We present rigorous theoretical analyses of the task assignment optimization problem and propose optimal and approximation algorithms with guarantees, which rely on index pre-computation and adaptive maintenance. We perform extensive performance and quality experiments using real and synthetic data to demonstrate that the SmartCrowd approach is necessary to achieve efficient task assignments of high-quality under guaranteed cost budget.",
keywords = "Collaborative crowdsourcing, Human factors, Knowledge-intensive crowdsourcing, Optimization",
author = "{Basu Roy}, Senjuti and Ioanna Lykourentzou and Saravanan Thirumuruganathan and Sihem Amer-Yahia and Gautam Das",
year = "2015",
month = "8",
day = "24",
doi = "10.1007/s00778-015-0385-2",
language = "English",
volume = "24",
pages = "467--491",
journal = "VLDB Journal",
issn = "1066-8888",
publisher = "Springer New York",
number = "4",

}

TY - JOUR

T1 - Task assignment optimization in knowledge-intensive crowdsourcing

AU - Basu Roy, Senjuti

AU - Lykourentzou, Ioanna

AU - Thirumuruganathan, Saravanan

AU - Amer-Yahia, Sihem

AU - Das, Gautam

PY - 2015/8/24

Y1 - 2015/8/24

N2 - We present SmartCrowd, a framework for optimizing task assignment in knowledge-intensive crowdsourcing (KI-C). SmartCrowd distinguishes itself by formulating, for the first time, the problem of worker-to-task assignment in KI-C as an optimization problem, by proposing efficient adaptive algorithms to solve it and by accounting for human factors, such as worker expertise, wage requirements, and availability inside the optimization process. We present rigorous theoretical analyses of the task assignment optimization problem and propose optimal and approximation algorithms with guarantees, which rely on index pre-computation and adaptive maintenance. We perform extensive performance and quality experiments using real and synthetic data to demonstrate that the SmartCrowd approach is necessary to achieve efficient task assignments of high-quality under guaranteed cost budget.

AB - We present SmartCrowd, a framework for optimizing task assignment in knowledge-intensive crowdsourcing (KI-C). SmartCrowd distinguishes itself by formulating, for the first time, the problem of worker-to-task assignment in KI-C as an optimization problem, by proposing efficient adaptive algorithms to solve it and by accounting for human factors, such as worker expertise, wage requirements, and availability inside the optimization process. We present rigorous theoretical analyses of the task assignment optimization problem and propose optimal and approximation algorithms with guarantees, which rely on index pre-computation and adaptive maintenance. We perform extensive performance and quality experiments using real and synthetic data to demonstrate that the SmartCrowd approach is necessary to achieve efficient task assignments of high-quality under guaranteed cost budget.

KW - Collaborative crowdsourcing

KW - Human factors

KW - Knowledge-intensive crowdsourcing

KW - Optimization

UR - http://www.scopus.com/inward/record.url?scp=84937968933&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84937968933&partnerID=8YFLogxK

U2 - 10.1007/s00778-015-0385-2

DO - 10.1007/s00778-015-0385-2

M3 - Article

VL - 24

SP - 467

EP - 491

JO - VLDB Journal

JF - VLDB Journal

SN - 1066-8888

IS - 4

ER -