Simple effective microblog named entity recognition

Arabic as an example

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

Despite many recent papers on Arabic Named Entity Recognition (NER) in the news domain, little work has been done on microblog NER. NER on microblogs presents many complications such as informality of language, shortened named entities, brevity of expressions, and inconsistent capitalization (for cased languages). We introduce simple effective language-independent approaches for improving NER on microblogs, based on using large gazetteers, domain adaptation, and a two-pass semi-supervised method. We use Arabic as an example language to compare the relative effectiveness of the approaches and when best to use them. We also present a new dataset for the task. Results of combining the proposed approaches show an improvement of 35.3 F-measure points over a baseline system trained on news data and an improvement of 19.9 F-measure points over the same system but trained on microblog data.

Original languageEnglish
Title of host publicationProceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014
PublisherEuropean Language Resources Association (ELRA)
Pages2513-2517
Number of pages5
ISBN (Electronic)9782951740884
Publication statusPublished - 1 Jan 2014
Event9th International Conference on Language Resources and Evaluation, LREC 2014 - Reykjavik, Iceland
Duration: 26 May 201431 May 2014

Other

Other9th International Conference on Language Resources and Evaluation, LREC 2014
CountryIceland
CityReykjavik
Period26/5/1431/5/14

Fingerprint

language
news
Entity
Language
News
Capitalization
Complications
Informality

Keywords

  • Arabic
  • Microblogs
  • Named entity recognition

ASJC Scopus subject areas

  • Linguistics and Language
  • Library and Information Sciences
  • Education
  • Language and Linguistics

Cite this

Darwish, K., & Gao, W. (2014). Simple effective microblog named entity recognition: Arabic as an example. In Proceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014 (pp. 2513-2517). European Language Resources Association (ELRA).

Simple effective microblog named entity recognition : Arabic as an example. / Darwish, Kareem; Gao, Wei.

Proceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014. European Language Resources Association (ELRA), 2014. p. 2513-2517.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Darwish, K & Gao, W 2014, Simple effective microblog named entity recognition: Arabic as an example. in Proceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014. European Language Resources Association (ELRA), pp. 2513-2517, 9th International Conference on Language Resources and Evaluation, LREC 2014, Reykjavik, Iceland, 26/5/14.
Darwish K, Gao W. Simple effective microblog named entity recognition: Arabic as an example. In Proceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014. European Language Resources Association (ELRA). 2014. p. 2513-2517
Darwish, Kareem ; Gao, Wei. / Simple effective microblog named entity recognition : Arabic as an example. Proceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014. European Language Resources Association (ELRA), 2014. pp. 2513-2517
@inproceedings{066d2bf939064944884016fc0844c5f2,
title = "Simple effective microblog named entity recognition: Arabic as an example",
abstract = "Despite many recent papers on Arabic Named Entity Recognition (NER) in the news domain, little work has been done on microblog NER. NER on microblogs presents many complications such as informality of language, shortened named entities, brevity of expressions, and inconsistent capitalization (for cased languages). We introduce simple effective language-independent approaches for improving NER on microblogs, based on using large gazetteers, domain adaptation, and a two-pass semi-supervised method. We use Arabic as an example language to compare the relative effectiveness of the approaches and when best to use them. We also present a new dataset for the task. Results of combining the proposed approaches show an improvement of 35.3 F-measure points over a baseline system trained on news data and an improvement of 19.9 F-measure points over the same system but trained on microblog data.",
keywords = "Arabic, Microblogs, Named entity recognition",
author = "Kareem Darwish and Wei Gao",
year = "2014",
month = "1",
day = "1",
language = "English",
pages = "2513--2517",
booktitle = "Proceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014",
publisher = "European Language Resources Association (ELRA)",

}

TY - GEN

T1 - Simple effective microblog named entity recognition

T2 - Arabic as an example

AU - Darwish, Kareem

AU - Gao, Wei

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Despite many recent papers on Arabic Named Entity Recognition (NER) in the news domain, little work has been done on microblog NER. NER on microblogs presents many complications such as informality of language, shortened named entities, brevity of expressions, and inconsistent capitalization (for cased languages). We introduce simple effective language-independent approaches for improving NER on microblogs, based on using large gazetteers, domain adaptation, and a two-pass semi-supervised method. We use Arabic as an example language to compare the relative effectiveness of the approaches and when best to use them. We also present a new dataset for the task. Results of combining the proposed approaches show an improvement of 35.3 F-measure points over a baseline system trained on news data and an improvement of 19.9 F-measure points over the same system but trained on microblog data.

AB - Despite many recent papers on Arabic Named Entity Recognition (NER) in the news domain, little work has been done on microblog NER. NER on microblogs presents many complications such as informality of language, shortened named entities, brevity of expressions, and inconsistent capitalization (for cased languages). We introduce simple effective language-independent approaches for improving NER on microblogs, based on using large gazetteers, domain adaptation, and a two-pass semi-supervised method. We use Arabic as an example language to compare the relative effectiveness of the approaches and when best to use them. We also present a new dataset for the task. Results of combining the proposed approaches show an improvement of 35.3 F-measure points over a baseline system trained on news data and an improvement of 19.9 F-measure points over the same system but trained on microblog data.

KW - Arabic

KW - Microblogs

KW - Named entity recognition

UR - http://www.scopus.com/inward/record.url?scp=85034858592&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85034858592&partnerID=8YFLogxK

M3 - Conference contribution

SP - 2513

EP - 2517

BT - Proceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014

PB - European Language Resources Association (ELRA)

ER -