Thread-level information for comment classification in community question answering

Research output: Chapter in Book/Report/Conference proceedingConference contribution

32 Citations (Scopus)

Abstract

Community Question Answering (cQA) is a new application of QA in social contexts (e.g., fora). It presents new interesting challenges and research directions, e.g., exploiting the dependencies between the different comments of a thread to select the best answer for a given question. In this paper, we explored two ways of modeling such dependencies: (i) by designing specific features looking globally at the thread; and (ii) by applying structure prediction models. We trained and evaluated our models on data from SemEval-2015 Task 3 on Answer Selection in cQA. Our experiments show that: (i) the thread-level features consistently improve the performance for a variety of machine learning models, yielding state-of-the-art results; and (ii) sequential dependencies between the answer labels captured by structured prediction models are not enough to improve the results, indicating that more information is needed in the joint model.

Original languageEnglish
Title of host publicationACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference
PublisherAssociation for Computational Linguistics (ACL)
Pages687-693
Number of pages7
Volume2
ISBN (Print)9781941643730
Publication statusPublished - 2015
Event53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL-IJCNLP 2015 - Beijing, China
Duration: 26 Jul 201531 Jul 2015

Other

Other53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL-IJCNLP 2015
CountryChina
CityBeijing
Period26/7/1531/7/15

Fingerprint

Learning systems
Labels
Experiments

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software

Cite this

Barron, A., Filice, S., Martino, G., Rayhan Joty, S., Marques, L., Nakov, P., & Moschitti, A. (2015). Thread-level information for comment classification in community question answering. In ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference (Vol. 2, pp. 687-693). Association for Computational Linguistics (ACL).

Thread-level information for comment classification in community question answering. / Barron, Alberto; Filice, Simone; Martino, Giovanni; Rayhan Joty, Shafiq; Marques, Lluis; Nakov, Preslav; Moschitti, Alessandro.

ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference. Vol. 2 Association for Computational Linguistics (ACL), 2015. p. 687-693.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Barron, A, Filice, S, Martino, G, Rayhan Joty, S, Marques, L, Nakov, P & Moschitti, A 2015, Thread-level information for comment classification in community question answering. in ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference. vol. 2, Association for Computational Linguistics (ACL), pp. 687-693, 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL-IJCNLP 2015, Beijing, China, 26/7/15.
Barron A, Filice S, Martino G, Rayhan Joty S, Marques L, Nakov P et al. Thread-level information for comment classification in community question answering. In ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference. Vol. 2. Association for Computational Linguistics (ACL). 2015. p. 687-693
Barron, Alberto ; Filice, Simone ; Martino, Giovanni ; Rayhan Joty, Shafiq ; Marques, Lluis ; Nakov, Preslav ; Moschitti, Alessandro. / Thread-level information for comment classification in community question answering. ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference. Vol. 2 Association for Computational Linguistics (ACL), 2015. pp. 687-693
@inproceedings{d71bd98f35c64d7fb3b9a180afc06227,
title = "Thread-level information for comment classification in community question answering",
abstract = "Community Question Answering (cQA) is a new application of QA in social contexts (e.g., fora). It presents new interesting challenges and research directions, e.g., exploiting the dependencies between the different comments of a thread to select the best answer for a given question. In this paper, we explored two ways of modeling such dependencies: (i) by designing specific features looking globally at the thread; and (ii) by applying structure prediction models. We trained and evaluated our models on data from SemEval-2015 Task 3 on Answer Selection in cQA. Our experiments show that: (i) the thread-level features consistently improve the performance for a variety of machine learning models, yielding state-of-the-art results; and (ii) sequential dependencies between the answer labels captured by structured prediction models are not enough to improve the results, indicating that more information is needed in the joint model.",
author = "Alberto Barron and Simone Filice and Giovanni Martino and {Rayhan Joty}, Shafiq and Lluis Marques and Preslav Nakov and Alessandro Moschitti",
year = "2015",
language = "English",
isbn = "9781941643730",
volume = "2",
pages = "687--693",
booktitle = "ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference",
publisher = "Association for Computational Linguistics (ACL)",

}

TY - GEN

T1 - Thread-level information for comment classification in community question answering

AU - Barron, Alberto

AU - Filice, Simone

AU - Martino, Giovanni

AU - Rayhan Joty, Shafiq

AU - Marques, Lluis

AU - Nakov, Preslav

AU - Moschitti, Alessandro

PY - 2015

Y1 - 2015

N2 - Community Question Answering (cQA) is a new application of QA in social contexts (e.g., fora). It presents new interesting challenges and research directions, e.g., exploiting the dependencies between the different comments of a thread to select the best answer for a given question. In this paper, we explored two ways of modeling such dependencies: (i) by designing specific features looking globally at the thread; and (ii) by applying structure prediction models. We trained and evaluated our models on data from SemEval-2015 Task 3 on Answer Selection in cQA. Our experiments show that: (i) the thread-level features consistently improve the performance for a variety of machine learning models, yielding state-of-the-art results; and (ii) sequential dependencies between the answer labels captured by structured prediction models are not enough to improve the results, indicating that more information is needed in the joint model.

AB - Community Question Answering (cQA) is a new application of QA in social contexts (e.g., fora). It presents new interesting challenges and research directions, e.g., exploiting the dependencies between the different comments of a thread to select the best answer for a given question. In this paper, we explored two ways of modeling such dependencies: (i) by designing specific features looking globally at the thread; and (ii) by applying structure prediction models. We trained and evaluated our models on data from SemEval-2015 Task 3 on Answer Selection in cQA. Our experiments show that: (i) the thread-level features consistently improve the performance for a variety of machine learning models, yielding state-of-the-art results; and (ii) sequential dependencies between the answer labels captured by structured prediction models are not enough to improve the results, indicating that more information is needed in the joint model.

UR - http://www.scopus.com/inward/record.url?scp=84944069941&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84944069941&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84944069941

SN - 9781941643730

VL - 2

SP - 687

EP - 693

BT - ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference

PB - Association for Computational Linguistics (ACL)

ER -