Named entity recognition using cross-lingual resources

Arabic as an example

Research output: Chapter in Book/Report/Conference proceedingConference contribution

20 Citations (Scopus)

Abstract

Some languages lack large knowledge bases and good discriminative features for Name Entity Recognition (NER) that can generalize to previously unseen named entities. One such language is Arabic, which: a) lacks a capitalization feature; and b) has relatively small knowledge bases, such as Wikipedia. In this work we address both problems by incorporating cross-lingual features and knowledge bases from English using cross-lingual links. We show that such features have a dramatic positive effect on recall. We show the effectiveness of cross-lingual features and resources on a standard dataset as well as on two new test sets that cover both news and microblogs. On the standard dataset, we achieved a 4.1% relative improvement in F-measure over the best reported result in the literature. The features led to improvements of 17.1% and 20.5% on the new news and microblogs test sets respectively.

Original languageEnglish
Title of host publicationACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference
PublisherAssociation for Computational Linguistics (ACL)
Pages1558-1567
Number of pages10
Volume1
ISBN (Print)9781937284503
Publication statusPublished - 1 Jan 2013
Event51st Annual Meeting of the Association for Computational Linguistics, ACL 2013 - Sofia, Bulgaria
Duration: 4 Aug 20139 Aug 2013

Other

Other51st Annual Meeting of the Association for Computational Linguistics, ACL 2013
CountryBulgaria
CitySofia
Period4/8/139/8/13

Fingerprint

news
Wikipedia
lack
language
resources
Language
Resources
Entity
News
literature
Capitalization
Names

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language

Cite this

Darwish, K. (2013). Named entity recognition using cross-lingual resources: Arabic as an example. In ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Vol. 1, pp. 1558-1567). Association for Computational Linguistics (ACL).

Named entity recognition using cross-lingual resources : Arabic as an example. / Darwish, Kareem.

ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Vol. 1 Association for Computational Linguistics (ACL), 2013. p. 1558-1567.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Darwish, K 2013, Named entity recognition using cross-lingual resources: Arabic as an example. in ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. vol. 1, Association for Computational Linguistics (ACL), pp. 1558-1567, 51st Annual Meeting of the Association for Computational Linguistics, ACL 2013, Sofia, Bulgaria, 4/8/13.
Darwish K. Named entity recognition using cross-lingual resources: Arabic as an example. In ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Vol. 1. Association for Computational Linguistics (ACL). 2013. p. 1558-1567
Darwish, Kareem. / Named entity recognition using cross-lingual resources : Arabic as an example. ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Vol. 1 Association for Computational Linguistics (ACL), 2013. pp. 1558-1567
@inproceedings{9ab8c03708294776a2dba669486094ff,
title = "Named entity recognition using cross-lingual resources: Arabic as an example",
abstract = "Some languages lack large knowledge bases and good discriminative features for Name Entity Recognition (NER) that can generalize to previously unseen named entities. One such language is Arabic, which: a) lacks a capitalization feature; and b) has relatively small knowledge bases, such as Wikipedia. In this work we address both problems by incorporating cross-lingual features and knowledge bases from English using cross-lingual links. We show that such features have a dramatic positive effect on recall. We show the effectiveness of cross-lingual features and resources on a standard dataset as well as on two new test sets that cover both news and microblogs. On the standard dataset, we achieved a 4.1{\%} relative improvement in F-measure over the best reported result in the literature. The features led to improvements of 17.1{\%} and 20.5{\%} on the new news and microblogs test sets respectively.",
author = "Kareem Darwish",
year = "2013",
month = "1",
day = "1",
language = "English",
isbn = "9781937284503",
volume = "1",
pages = "1558--1567",
booktitle = "ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference",
publisher = "Association for Computational Linguistics (ACL)",

}

TY - GEN

T1 - Named entity recognition using cross-lingual resources

T2 - Arabic as an example

AU - Darwish, Kareem

PY - 2013/1/1

Y1 - 2013/1/1

N2 - Some languages lack large knowledge bases and good discriminative features for Name Entity Recognition (NER) that can generalize to previously unseen named entities. One such language is Arabic, which: a) lacks a capitalization feature; and b) has relatively small knowledge bases, such as Wikipedia. In this work we address both problems by incorporating cross-lingual features and knowledge bases from English using cross-lingual links. We show that such features have a dramatic positive effect on recall. We show the effectiveness of cross-lingual features and resources on a standard dataset as well as on two new test sets that cover both news and microblogs. On the standard dataset, we achieved a 4.1% relative improvement in F-measure over the best reported result in the literature. The features led to improvements of 17.1% and 20.5% on the new news and microblogs test sets respectively.

AB - Some languages lack large knowledge bases and good discriminative features for Name Entity Recognition (NER) that can generalize to previously unseen named entities. One such language is Arabic, which: a) lacks a capitalization feature; and b) has relatively small knowledge bases, such as Wikipedia. In this work we address both problems by incorporating cross-lingual features and knowledge bases from English using cross-lingual links. We show that such features have a dramatic positive effect on recall. We show the effectiveness of cross-lingual features and resources on a standard dataset as well as on two new test sets that cover both news and microblogs. On the standard dataset, we achieved a 4.1% relative improvement in F-measure over the best reported result in the literature. The features led to improvements of 17.1% and 20.5% on the new news and microblogs test sets respectively.

UR - http://www.scopus.com/inward/record.url?scp=84893610020&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84893610020&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9781937284503

VL - 1

SP - 1558

EP - 1567

BT - ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

PB - Association for Computational Linguistics (ACL)

ER -