CheckThat! at CLEF 2019: Automatic identification and verification of claims

Tamer Elsayed, Preslav Nakov, Alberto Barron, Maram Hasanain, Reem Suwaileh, Giovanni Martino, Pepa Atanasova

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

We introduce the second edition of the CheckThat! Lab, part of the 2019 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes two complementary tasks. Task 1: predict which claims in a political debate should be prioritized for fact-checking. Task 2: rank Web-retrieved pages against a check-worthy claim based on their usefulness for fact-checking, extract useful passages from those pages, and then use them all to decide whether the claim is factually true or false. Checkthat! provides a full evaluation framework, consisting of data in English (derived from fact-checking sources) and Arabic (gathered and annotated from scratch) and evaluation based on mean average precision (MAP) for ranking and F 1 for classification tasks.

Original languageEnglish
Title of host publicationAdvances in Information Retrieval - 41st European Conference on IR Research, ECIR 2019, Proceedings
EditorsBenno Stein, Philipp Mayr, Leif Azzopardi, Norbert Fuhr, Claudia Hauff, Djoerd Hiemstra
PublisherSpringer Verlag
Pages309-315
Number of pages7
ISBN (Print)9783030157180
DOIs
Publication statusPublished - 1 Jan 2019
Event41st European Conference on Information Retrieval, ECIR 2019 - Cologne, Germany
Duration: 14 Apr 201918 Apr 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11438 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference41st European Conference on Information Retrieval, ECIR 2019
CountryGermany
CityCologne
Period14/4/1918/4/19

    Fingerprint

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Elsayed, T., Nakov, P., Barron, A., Hasanain, M., Suwaileh, R., Martino, G., & Atanasova, P. (2019). CheckThat! at CLEF 2019: Automatic identification and verification of claims. In B. Stein, P. Mayr, L. Azzopardi, N. Fuhr, C. Hauff, & D. Hiemstra (Eds.), Advances in Information Retrieval - 41st European Conference on IR Research, ECIR 2019, Proceedings (pp. 309-315). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11438 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-15719-7_41