Designing a human-machine hybrid computing system for unstructured data analytics

Koushik Sinha, Geetha Manjunath, Bidyut Gupta, Shahram Rahimi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Current machine algorithms for analysis of unstructured data typically show low accuracies due to the need for human-like intelligence. Conversely, though humans are much better than machine algorithms on analyzing unstructured data, they are unpredictable, slower and can be erroneous or even malicious as computing agents. Therefore, a hybrid platform that can intelligently orchestrate machine and human computing resources would potentially be capable of providing significantly better benefits compared to either type of computing agent in isolation. In this paper, we propose a new hybrid human-machine computing platform with integrated service level objectives (SLO) management for complex tasks that can be decomposed into a dependency graph where nodes represent subtasks. Initial experimental results are highly encouraging. To the best of our knowledge, ours is the first work that attempts to design such a hybrid human-machine computing platform with support for addressing the three SLO parameters of accuracy, budget and completion time. Copyright ISCA.

Original languageEnglish
Title of host publicationProceedings of the 31st International Conference on Computers and Their Applications, CATA 2016
PublisherThe International Society for Computers and Their Applications (ISCA)
Pages23-28
Number of pages6
ISBN (Electronic)9781943436026
Publication statusPublished - 2016
Externally publishedYes
Event31st International Conference on Computers and Their Applications, CATA 2016 - Las Vegas, United States
Duration: 4 Apr 20166 Apr 2016

Other

Other31st International Conference on Computers and Their Applications, CATA 2016
CountryUnited States
CityLas Vegas
Period4/4/166/4/16

Keywords

  • Crowdsourcing
  • Data analytics
  • Human augmented computing
  • Microtask
  • Service level objectives
  • Task scheduling

ASJC Scopus subject areas

  • Computer Science Applications

Cite this

Sinha, K., Manjunath, G., Gupta, B., & Rahimi, S. (2016). Designing a human-machine hybrid computing system for unstructured data analytics. In Proceedings of the 31st International Conference on Computers and Their Applications, CATA 2016 (pp. 23-28). The International Society for Computers and Their Applications (ISCA).

Designing a human-machine hybrid computing system for unstructured data analytics. / Sinha, Koushik; Manjunath, Geetha; Gupta, Bidyut; Rahimi, Shahram.

Proceedings of the 31st International Conference on Computers and Their Applications, CATA 2016. The International Society for Computers and Their Applications (ISCA), 2016. p. 23-28.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sinha, K, Manjunath, G, Gupta, B & Rahimi, S 2016, Designing a human-machine hybrid computing system for unstructured data analytics. in Proceedings of the 31st International Conference on Computers and Their Applications, CATA 2016. The International Society for Computers and Their Applications (ISCA), pp. 23-28, 31st International Conference on Computers and Their Applications, CATA 2016, Las Vegas, United States, 4/4/16.
Sinha K, Manjunath G, Gupta B, Rahimi S. Designing a human-machine hybrid computing system for unstructured data analytics. In Proceedings of the 31st International Conference on Computers and Their Applications, CATA 2016. The International Society for Computers and Their Applications (ISCA). 2016. p. 23-28
Sinha, Koushik ; Manjunath, Geetha ; Gupta, Bidyut ; Rahimi, Shahram. / Designing a human-machine hybrid computing system for unstructured data analytics. Proceedings of the 31st International Conference on Computers and Their Applications, CATA 2016. The International Society for Computers and Their Applications (ISCA), 2016. pp. 23-28
@inproceedings{7bb8b3db4ef0480d9744139e973b0627,
title = "Designing a human-machine hybrid computing system for unstructured data analytics",
abstract = "Current machine algorithms for analysis of unstructured data typically show low accuracies due to the need for human-like intelligence. Conversely, though humans are much better than machine algorithms on analyzing unstructured data, they are unpredictable, slower and can be erroneous or even malicious as computing agents. Therefore, a hybrid platform that can intelligently orchestrate machine and human computing resources would potentially be capable of providing significantly better benefits compared to either type of computing agent in isolation. In this paper, we propose a new hybrid human-machine computing platform with integrated service level objectives (SLO) management for complex tasks that can be decomposed into a dependency graph where nodes represent subtasks. Initial experimental results are highly encouraging. To the best of our knowledge, ours is the first work that attempts to design such a hybrid human-machine computing platform with support for addressing the three SLO parameters of accuracy, budget and completion time. Copyright ISCA.",
keywords = "Crowdsourcing, Data analytics, Human augmented computing, Microtask, Service level objectives, Task scheduling",
author = "Koushik Sinha and Geetha Manjunath and Bidyut Gupta and Shahram Rahimi",
year = "2016",
language = "English",
pages = "23--28",
booktitle = "Proceedings of the 31st International Conference on Computers and Their Applications, CATA 2016",
publisher = "The International Society for Computers and Their Applications (ISCA)",

}

TY - GEN

T1 - Designing a human-machine hybrid computing system for unstructured data analytics

AU - Sinha, Koushik

AU - Manjunath, Geetha

AU - Gupta, Bidyut

AU - Rahimi, Shahram

PY - 2016

Y1 - 2016

N2 - Current machine algorithms for analysis of unstructured data typically show low accuracies due to the need for human-like intelligence. Conversely, though humans are much better than machine algorithms on analyzing unstructured data, they are unpredictable, slower and can be erroneous or even malicious as computing agents. Therefore, a hybrid platform that can intelligently orchestrate machine and human computing resources would potentially be capable of providing significantly better benefits compared to either type of computing agent in isolation. In this paper, we propose a new hybrid human-machine computing platform with integrated service level objectives (SLO) management for complex tasks that can be decomposed into a dependency graph where nodes represent subtasks. Initial experimental results are highly encouraging. To the best of our knowledge, ours is the first work that attempts to design such a hybrid human-machine computing platform with support for addressing the three SLO parameters of accuracy, budget and completion time. Copyright ISCA.

AB - Current machine algorithms for analysis of unstructured data typically show low accuracies due to the need for human-like intelligence. Conversely, though humans are much better than machine algorithms on analyzing unstructured data, they are unpredictable, slower and can be erroneous or even malicious as computing agents. Therefore, a hybrid platform that can intelligently orchestrate machine and human computing resources would potentially be capable of providing significantly better benefits compared to either type of computing agent in isolation. In this paper, we propose a new hybrid human-machine computing platform with integrated service level objectives (SLO) management for complex tasks that can be decomposed into a dependency graph where nodes represent subtasks. Initial experimental results are highly encouraging. To the best of our knowledge, ours is the first work that attempts to design such a hybrid human-machine computing platform with support for addressing the three SLO parameters of accuracy, budget and completion time. Copyright ISCA.

KW - Crowdsourcing

KW - Data analytics

KW - Human augmented computing

KW - Microtask

KW - Service level objectives

KW - Task scheduling

UR - http://www.scopus.com/inward/record.url?scp=84973370340&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84973370340&partnerID=8YFLogxK

M3 - Conference contribution

SP - 23

EP - 28

BT - Proceedings of the 31st International Conference on Computers and Their Applications, CATA 2016

PB - The International Society for Computers and Their Applications (ISCA)

ER -