Using syntactic and semantic structural kernels for classifying definition questions in Jeopardy!

Alessandro Moschitti, Jennifer Chu-Carroll, Siddharth Patwardhan, James Fan, Giuseppe Riccardi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

The last decade has seen many interesting applications of Question Answering (QA) technology. The Jeopardy! quiz show is certainly one of the most fascinating, from the viewpoints of both its broad domain and the complexity of its language. In this paper, we study kernel methods applied to syntactic/semantic structures for accurate classification of Jeopardy! definition questions. Our extensive empirical analysis shows that our classification models largely improve on classifiers based on word-language models. Such classifiers are also used in the state-of-the-art QA pipeline constituting Watson, the IBM Jeopardy! system. Our experiments measuring their impact on Watson show enhancements in QA accuracy and a consequent increase in the amount of money earned in game-based evaluation.

Original languageEnglish
Title of host publicationEMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference
Pages712-724
Number of pages13
Publication statusPublished - 3 Oct 2011
Externally publishedYes
EventConference on Empirical Methods in Natural Language Processing, EMNLP 2011 - Edinburgh, United Kingdom
Duration: 27 Jul 201131 Jul 2011

Other

OtherConference on Empirical Methods in Natural Language Processing, EMNLP 2011
CountryUnited Kingdom
CityEdinburgh
Period27/7/1131/7/11

Fingerprint

Syntactics
Classifiers
Semantics
Pipelines
Experiments

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Computer Science Applications
  • Information Systems

Cite this

Moschitti, A., Chu-Carroll, J., Patwardhan, S., Fan, J., & Riccardi, G. (2011). Using syntactic and semantic structural kernels for classifying definition questions in Jeopardy! In EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference (pp. 712-724)

Using syntactic and semantic structural kernels for classifying definition questions in Jeopardy! / Moschitti, Alessandro; Chu-Carroll, Jennifer; Patwardhan, Siddharth; Fan, James; Riccardi, Giuseppe.

EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference. 2011. p. 712-724.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Moschitti, A, Chu-Carroll, J, Patwardhan, S, Fan, J & Riccardi, G 2011, Using syntactic and semantic structural kernels for classifying definition questions in Jeopardy! in EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference. pp. 712-724, Conference on Empirical Methods in Natural Language Processing, EMNLP 2011, Edinburgh, United Kingdom, 27/7/11.
Moschitti A, Chu-Carroll J, Patwardhan S, Fan J, Riccardi G. Using syntactic and semantic structural kernels for classifying definition questions in Jeopardy! In EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference. 2011. p. 712-724
Moschitti, Alessandro ; Chu-Carroll, Jennifer ; Patwardhan, Siddharth ; Fan, James ; Riccardi, Giuseppe. / Using syntactic and semantic structural kernels for classifying definition questions in Jeopardy!. EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference. 2011. pp. 712-724
@inproceedings{c64f0ef2281748c39714d7183b546a67,
title = "Using syntactic and semantic structural kernels for classifying definition questions in Jeopardy!",
abstract = "The last decade has seen many interesting applications of Question Answering (QA) technology. The Jeopardy! quiz show is certainly one of the most fascinating, from the viewpoints of both its broad domain and the complexity of its language. In this paper, we study kernel methods applied to syntactic/semantic structures for accurate classification of Jeopardy! definition questions. Our extensive empirical analysis shows that our classification models largely improve on classifiers based on word-language models. Such classifiers are also used in the state-of-the-art QA pipeline constituting Watson, the IBM Jeopardy! system. Our experiments measuring their impact on Watson show enhancements in QA accuracy and a consequent increase in the amount of money earned in game-based evaluation.",
author = "Alessandro Moschitti and Jennifer Chu-Carroll and Siddharth Patwardhan and James Fan and Giuseppe Riccardi",
year = "2011",
month = "10",
day = "3",
language = "English",
isbn = "1937284115",
pages = "712--724",
booktitle = "EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference",

}

TY - GEN

T1 - Using syntactic and semantic structural kernels for classifying definition questions in Jeopardy!

AU - Moschitti, Alessandro

AU - Chu-Carroll, Jennifer

AU - Patwardhan, Siddharth

AU - Fan, James

AU - Riccardi, Giuseppe

PY - 2011/10/3

Y1 - 2011/10/3

N2 - The last decade has seen many interesting applications of Question Answering (QA) technology. The Jeopardy! quiz show is certainly one of the most fascinating, from the viewpoints of both its broad domain and the complexity of its language. In this paper, we study kernel methods applied to syntactic/semantic structures for accurate classification of Jeopardy! definition questions. Our extensive empirical analysis shows that our classification models largely improve on classifiers based on word-language models. Such classifiers are also used in the state-of-the-art QA pipeline constituting Watson, the IBM Jeopardy! system. Our experiments measuring their impact on Watson show enhancements in QA accuracy and a consequent increase in the amount of money earned in game-based evaluation.

AB - The last decade has seen many interesting applications of Question Answering (QA) technology. The Jeopardy! quiz show is certainly one of the most fascinating, from the viewpoints of both its broad domain and the complexity of its language. In this paper, we study kernel methods applied to syntactic/semantic structures for accurate classification of Jeopardy! definition questions. Our extensive empirical analysis shows that our classification models largely improve on classifiers based on word-language models. Such classifiers are also used in the state-of-the-art QA pipeline constituting Watson, the IBM Jeopardy! system. Our experiments measuring their impact on Watson show enhancements in QA accuracy and a consequent increase in the amount of money earned in game-based evaluation.

UR - http://www.scopus.com/inward/record.url?scp=80053224203&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80053224203&partnerID=8YFLogxK

M3 - Conference contribution

SN - 1937284115

SN - 9781937284114

SP - 712

EP - 724

BT - EMNLP 2011 - Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference

ER -