Automatic fact-checking using context and discourse information

Pepa Atanasova, Preslav Nakov, Lluís Màrquez, Alberto Barrón-Cedeño, Georgi Karadzhov, Tsvetomila Mihaylova, Mitra Mohtarami, James Glass

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

We study the problem of automatic fact-checking, paying special attention to the impact of contextual and discourse information. We address two related tasks: (i) detecting check-worthy claims and (ii) fact-checking claims.We develop supervised systems based on neural networks, kernel-based support vector machines, and combinations thereof, which make use of rich input representations in terms of discourse cues and contextual features. For the check-worthiness estimation task, we focus on political debates, and we model the target claim in the context of the full intervention of a participant and the previous and following turns in the debate, taking into account contextual meta information. For the fact-checking task, we focus on answer verification in a community forum, and we model the veracity of the answer with respect to the entire question-answer thread in which it occurs as well as with respect to other related posts from the entire forum. We develop annotated datasets for both tasks and we run extensive experimental evaluation, confirming that both types of information-but especially contextual features-play an important role.

Original languageEnglish
Article number12
JournalJournal of Data and Information Quality
Volume11
Issue number3
DOIs
Publication statusPublished - Jul 2019

Fingerprint

Support vector machines
Neural networks
Discourse
Kernel
Evaluation
Thread
Support vector machine

Keywords

  • Community question-answering
  • Discourse
  • Fact-checking

ASJC Scopus subject areas

  • Information Systems
  • Information Systems and Management

Cite this

Automatic fact-checking using context and discourse information. / Atanasova, Pepa; Nakov, Preslav; Màrquez, Lluís; Barrón-Cedeño, Alberto; Karadzhov, Georgi; Mihaylova, Tsvetomila; Mohtarami, Mitra; Glass, James.

In: Journal of Data and Information Quality, Vol. 11, No. 3, 12, 07.2019.

Research output: Contribution to journalArticle

Atanasova, Pepa ; Nakov, Preslav ; Màrquez, Lluís ; Barrón-Cedeño, Alberto ; Karadzhov, Georgi ; Mihaylova, Tsvetomila ; Mohtarami, Mitra ; Glass, James. / Automatic fact-checking using context and discourse information. In: Journal of Data and Information Quality. 2019 ; Vol. 11, No. 3.
@article{78517aff44214298a52b2da24b2b0f4a,
title = "Automatic fact-checking using context and discourse information",
abstract = "We study the problem of automatic fact-checking, paying special attention to the impact of contextual and discourse information. We address two related tasks: (i) detecting check-worthy claims and (ii) fact-checking claims.We develop supervised systems based on neural networks, kernel-based support vector machines, and combinations thereof, which make use of rich input representations in terms of discourse cues and contextual features. For the check-worthiness estimation task, we focus on political debates, and we model the target claim in the context of the full intervention of a participant and the previous and following turns in the debate, taking into account contextual meta information. For the fact-checking task, we focus on answer verification in a community forum, and we model the veracity of the answer with respect to the entire question-answer thread in which it occurs as well as with respect to other related posts from the entire forum. We develop annotated datasets for both tasks and we run extensive experimental evaluation, confirming that both types of information-but especially contextual features-play an important role.",
keywords = "Community question-answering, Discourse, Fact-checking",
author = "Pepa Atanasova and Preslav Nakov and Llu{\'i}s M{\`a}rquez and Alberto Barr{\'o}n-Cede{\~n}o and Georgi Karadzhov and Tsvetomila Mihaylova and Mitra Mohtarami and James Glass",
year = "2019",
month = "7",
doi = "10.1145/3297722",
language = "English",
volume = "11",
journal = "Journal of Data and Information Quality",
issn = "1936-1955",
publisher = "Association for Computing Machinery (ACM)",
number = "3",

}

TY - JOUR

T1 - Automatic fact-checking using context and discourse information

AU - Atanasova, Pepa

AU - Nakov, Preslav

AU - Màrquez, Lluís

AU - Barrón-Cedeño, Alberto

AU - Karadzhov, Georgi

AU - Mihaylova, Tsvetomila

AU - Mohtarami, Mitra

AU - Glass, James

PY - 2019/7

Y1 - 2019/7

N2 - We study the problem of automatic fact-checking, paying special attention to the impact of contextual and discourse information. We address two related tasks: (i) detecting check-worthy claims and (ii) fact-checking claims.We develop supervised systems based on neural networks, kernel-based support vector machines, and combinations thereof, which make use of rich input representations in terms of discourse cues and contextual features. For the check-worthiness estimation task, we focus on political debates, and we model the target claim in the context of the full intervention of a participant and the previous and following turns in the debate, taking into account contextual meta information. For the fact-checking task, we focus on answer verification in a community forum, and we model the veracity of the answer with respect to the entire question-answer thread in which it occurs as well as with respect to other related posts from the entire forum. We develop annotated datasets for both tasks and we run extensive experimental evaluation, confirming that both types of information-but especially contextual features-play an important role.

AB - We study the problem of automatic fact-checking, paying special attention to the impact of contextual and discourse information. We address two related tasks: (i) detecting check-worthy claims and (ii) fact-checking claims.We develop supervised systems based on neural networks, kernel-based support vector machines, and combinations thereof, which make use of rich input representations in terms of discourse cues and contextual features. For the check-worthiness estimation task, we focus on political debates, and we model the target claim in the context of the full intervention of a participant and the previous and following turns in the debate, taking into account contextual meta information. For the fact-checking task, we focus on answer verification in a community forum, and we model the veracity of the answer with respect to the entire question-answer thread in which it occurs as well as with respect to other related posts from the entire forum. We develop annotated datasets for both tasks and we run extensive experimental evaluation, confirming that both types of information-but especially contextual features-play an important role.

KW - Community question-answering

KW - Discourse

KW - Fact-checking

UR - http://www.scopus.com/inward/record.url?scp=85070533807&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070533807&partnerID=8YFLogxK

U2 - 10.1145/3297722

DO - 10.1145/3297722

M3 - Article

AN - SCOPUS:85070533807

VL - 11

JO - Journal of Data and Information Quality

JF - Journal of Data and Information Quality

SN - 1936-1955

IS - 3

M1 - 12

ER -