A comprehensive resource to evaluate complex open domain question answering

Silvia Quarteroni, Alessandro Moschitti

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We describe two corpora of question and answer pairs collected for complex, open-domain Question Answering (QA) to enable answer classification and re-ranking experiments. We deliver manually annotated answers to non-factoid questions from a QA system on both Web and TREC data. Moreover, we provide the same question/answer pairs in a rich data representation that includes syntactic parse trees and predicate argument structures and is compatible with the SVM-light toolkit. Experimenting with the above corpora allowed us to learn effective answer classifiers and re-rankers to improve the accuracy of our baseline QA system.

Original languageEnglish
Title of host publicationProceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010
PublisherEuropean Language Resources Association (ELRA)
Pages3882-3887
Number of pages6
ISBN (Electronic)2951740867, 9782951740860
Publication statusPublished - 1 Jan 2010
Event7th International Conference on Language Resources and Evaluation, LREC 2010 - Valletta, Malta
Duration: 17 May 201023 May 2010

Other

Other7th International Conference on Language Resources and Evaluation, LREC 2010
CountryMalta
CityValletta
Period17/5/1023/5/10

Fingerprint

resources
ranking
experiment
Question Answering
Resources
World Wide Web
Toolkit
Syntax
Argument Structure
Ranking
Classifier
Experiment

ASJC Scopus subject areas

  • Education
  • Library and Information Sciences
  • Linguistics and Language
  • Language and Linguistics

Cite this

Quarteroni, S., & Moschitti, A. (2010). A comprehensive resource to evaluate complex open domain question answering. In Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010 (pp. 3882-3887). European Language Resources Association (ELRA).

A comprehensive resource to evaluate complex open domain question answering. / Quarteroni, Silvia; Moschitti, Alessandro.

Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010. European Language Resources Association (ELRA), 2010. p. 3882-3887.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Quarteroni, S & Moschitti, A 2010, A comprehensive resource to evaluate complex open domain question answering. in Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010. European Language Resources Association (ELRA), pp. 3882-3887, 7th International Conference on Language Resources and Evaluation, LREC 2010, Valletta, Malta, 17/5/10.
Quarteroni S, Moschitti A. A comprehensive resource to evaluate complex open domain question answering. In Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010. European Language Resources Association (ELRA). 2010. p. 3882-3887
Quarteroni, Silvia ; Moschitti, Alessandro. / A comprehensive resource to evaluate complex open domain question answering. Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010. European Language Resources Association (ELRA), 2010. pp. 3882-3887
@inproceedings{ac04ec05508246fd9d79572dbfe9775f,
title = "A comprehensive resource to evaluate complex open domain question answering",
abstract = "We describe two corpora of question and answer pairs collected for complex, open-domain Question Answering (QA) to enable answer classification and re-ranking experiments. We deliver manually annotated answers to non-factoid questions from a QA system on both Web and TREC data. Moreover, we provide the same question/answer pairs in a rich data representation that includes syntactic parse trees and predicate argument structures and is compatible with the SVM-light toolkit. Experimenting with the above corpora allowed us to learn effective answer classifiers and re-rankers to improve the accuracy of our baseline QA system.",
author = "Silvia Quarteroni and Alessandro Moschitti",
year = "2010",
month = "1",
day = "1",
language = "English",
pages = "3882--3887",
booktitle = "Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010",
publisher = "European Language Resources Association (ELRA)",

}

TY - GEN

T1 - A comprehensive resource to evaluate complex open domain question answering

AU - Quarteroni, Silvia

AU - Moschitti, Alessandro

PY - 2010/1/1

Y1 - 2010/1/1

N2 - We describe two corpora of question and answer pairs collected for complex, open-domain Question Answering (QA) to enable answer classification and re-ranking experiments. We deliver manually annotated answers to non-factoid questions from a QA system on both Web and TREC data. Moreover, we provide the same question/answer pairs in a rich data representation that includes syntactic parse trees and predicate argument structures and is compatible with the SVM-light toolkit. Experimenting with the above corpora allowed us to learn effective answer classifiers and re-rankers to improve the accuracy of our baseline QA system.

AB - We describe two corpora of question and answer pairs collected for complex, open-domain Question Answering (QA) to enable answer classification and re-ranking experiments. We deliver manually annotated answers to non-factoid questions from a QA system on both Web and TREC data. Moreover, we provide the same question/answer pairs in a rich data representation that includes syntactic parse trees and predicate argument structures and is compatible with the SVM-light toolkit. Experimenting with the above corpora allowed us to learn effective answer classifiers and re-rankers to improve the accuracy of our baseline QA system.

UR - http://www.scopus.com/inward/record.url?scp=85037535088&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85037535088&partnerID=8YFLogxK

M3 - Conference contribution

SP - 3882

EP - 3887

BT - Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010

PB - European Language Resources Association (ELRA)

ER -