Robustness and generalization of role sets: Propbank vs. VerbNet

Bẽnat Zapirain, Eneko Agirre, Llúis M̀arquez

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

This paper presents an empirical study on the robustness and generalization of two alternative role sets for semantic role labeling: Prop- Bank numbered roles and VerbNet thematic roles. By testing a state-of-the-art SRL system with the two alternative role annotations, we show that the PropBank role set is more robust to the lack of verb-specific semantic information and generalizes better to infrequent and unseen predicates. Keeping in mind that thematic roles are better for application needs, we also tested the best way to generate VerbNet annotation. We conclude that tagging first PropBank roles and mapping into Verb- Net roles is as effective as training and tagging directly on VerbNet, and more robust for domain shifts.

Original languageEnglish
Title of host publicationACL-08
Subtitle of host publicationHLT - 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference
Pages550-558
Number of pages9
Publication statusPublished - 1 Dec 2008
Event46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, ACL-08: HLT - Columbus, OH, United States
Duration: 15 Jun 200820 Jun 2008

Publication series

NameACL-08: HLT - 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference

Other

Other46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, ACL-08: HLT
CountryUnited States
CityColumbus, OH
Period15/6/0820/6/08

    Fingerprint

ASJC Scopus subject areas

  • Language and Linguistics
  • Computer Networks and Communications
  • Linguistics and Language

Cite this

Zapirain, B., Agirre, E., & M̀arquez, L. (2008). Robustness and generalization of role sets: Propbank vs. VerbNet. In ACL-08: HLT - 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference (pp. 550-558). (ACL-08: HLT - 46th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference).