Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages

Yoonsung Hong, Haewoon Kwak, Youngmin Baek, Sue Moon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

With the growing amount of textual data produced by online social media today, the demands for sentiment analysis are also rapidly increasing; and, this is true for worldwide. However, non-English languages often lack sentiment lexicons, a core resource in performing sentiment analysis. Our solution, Tower of Babel (ToB), is a language-independent sentiment-lexicon-generating crowdsourcing game. We conducted an experiment with 135 participants to explore the difference between our solution and a conventional manual annotation method. We evaluated ToB in terms of effectiveness, efficiency, and satisfactions. Based on the result of the evaluation, we conclude that sentiment classification via ToB is accurate, productive and enjoyable.

Original languageEnglish
Title of host publicationWWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web
Pages549-556
Number of pages8
Publication statusPublished - 1 Dec 2013
Externally publishedYes
Event22nd International Conference on World Wide Web, WWW 2013 - Rio de Janeiro, Brazil
Duration: 13 May 201317 May 2013

Other

Other22nd International Conference on World Wide Web, WWW 2013
CountryBrazil
CityRio de Janeiro
Period13/5/1317/5/13

Fingerprint

Towers
Experiments

Keywords

  • Distributed knowledge acquisition
  • Lexicon construction
  • Online games
  • Sentiment labeling
  • Worldwideweb

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Hong, Y., Kwak, H., Baek, Y., & Moon, S. (2013). Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages. In WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web (pp. 549-556)

Tower of babel : A crowdsourcing game building sentiment lexicons for resource-scarce languages. / Hong, Yoonsung; Kwak, Haewoon; Baek, Youngmin; Moon, Sue.

WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web. 2013. p. 549-556.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hong, Y, Kwak, H, Baek, Y & Moon, S 2013, Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages. in WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web. pp. 549-556, 22nd International Conference on World Wide Web, WWW 2013, Rio de Janeiro, Brazil, 13/5/13.
Hong Y, Kwak H, Baek Y, Moon S. Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages. In WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web. 2013. p. 549-556
Hong, Yoonsung ; Kwak, Haewoon ; Baek, Youngmin ; Moon, Sue. / Tower of babel : A crowdsourcing game building sentiment lexicons for resource-scarce languages. WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web. 2013. pp. 549-556
@inproceedings{0f21c03d56bd4adc8a35a7fc2a1a1cbe,
title = "Tower of babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages",
abstract = "With the growing amount of textual data produced by online social media today, the demands for sentiment analysis are also rapidly increasing; and, this is true for worldwide. However, non-English languages often lack sentiment lexicons, a core resource in performing sentiment analysis. Our solution, Tower of Babel (ToB), is a language-independent sentiment-lexicon-generating crowdsourcing game. We conducted an experiment with 135 participants to explore the difference between our solution and a conventional manual annotation method. We evaluated ToB in terms of effectiveness, efficiency, and satisfactions. Based on the result of the evaluation, we conclude that sentiment classification via ToB is accurate, productive and enjoyable.",
keywords = "Distributed knowledge acquisition, Lexicon construction, Online games, Sentiment labeling, Worldwideweb",
author = "Yoonsung Hong and Haewoon Kwak and Youngmin Baek and Sue Moon",
year = "2013",
month = "12",
day = "1",
language = "English",
isbn = "9781450320382",
pages = "549--556",
booktitle = "WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web",

}

TY - GEN

T1 - Tower of babel

T2 - A crowdsourcing game building sentiment lexicons for resource-scarce languages

AU - Hong, Yoonsung

AU - Kwak, Haewoon

AU - Baek, Youngmin

AU - Moon, Sue

PY - 2013/12/1

Y1 - 2013/12/1

N2 - With the growing amount of textual data produced by online social media today, the demands for sentiment analysis are also rapidly increasing; and, this is true for worldwide. However, non-English languages often lack sentiment lexicons, a core resource in performing sentiment analysis. Our solution, Tower of Babel (ToB), is a language-independent sentiment-lexicon-generating crowdsourcing game. We conducted an experiment with 135 participants to explore the difference between our solution and a conventional manual annotation method. We evaluated ToB in terms of effectiveness, efficiency, and satisfactions. Based on the result of the evaluation, we conclude that sentiment classification via ToB is accurate, productive and enjoyable.

AB - With the growing amount of textual data produced by online social media today, the demands for sentiment analysis are also rapidly increasing; and, this is true for worldwide. However, non-English languages often lack sentiment lexicons, a core resource in performing sentiment analysis. Our solution, Tower of Babel (ToB), is a language-independent sentiment-lexicon-generating crowdsourcing game. We conducted an experiment with 135 participants to explore the difference between our solution and a conventional manual annotation method. We evaluated ToB in terms of effectiveness, efficiency, and satisfactions. Based on the result of the evaluation, we conclude that sentiment classification via ToB is accurate, productive and enjoyable.

KW - Distributed knowledge acquisition

KW - Lexicon construction

KW - Online games

KW - Sentiment labeling

KW - Worldwideweb

UR - http://www.scopus.com/inward/record.url?scp=84893081154&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893081154&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84893081154

SN - 9781450320382

SP - 549

EP - 556

BT - WWW 2013 Companion - Proceedings of the 22nd International Conference on World Wide Web

ER -