EvalIta 2011: The frame labeling over Italian texts task

Roberto Basili, Diego De Cao, Alessandro Lenci, Alessandro Moschitti, Giulia Venturi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

The Frame Labeling over Italian Texts (FLaIT) task held within the EvalIta 2011 challenge is here described. It focuses on the automatic annotation of free texts according to frame semantics. Systems were asked to label all semantic frames and their arguments, as evoked by predicate words occurring in plain text sentences. Proposed systems are based on a variety of learning techniques and achieve very good results, over 80% of accuracy, in most subtasks.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages195-204
Number of pages10
Volume7689 LNAI
DOIs
Publication statusPublished - 1 Dec 2013
Externally publishedYes
EventInternational Workshop on Evaluation of Natural Language and Speech Tools for Italian, EVALITA 2011 - Rome, Italy
Duration: 24 Jan 201225 Jan 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7689 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

OtherInternational Workshop on Evaluation of Natural Language and Speech Tools for Italian, EVALITA 2011
CountryItaly
CityRome
Period24/1/1225/1/12

Fingerprint

Labeling
Semantics
Labels
Predicate
Annotation
Text
Learning

Keywords

  • Frame Semantics
  • NLP System Evaluation
  • Shallow Semantic Parsing

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Basili, R., De Cao, D., Lenci, A., Moschitti, A., & Venturi, G. (2013). EvalIta 2011: The frame labeling over Italian texts task. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 7689 LNAI, pp. 195-204). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7689 LNAI). https://doi.org/10.1007/978-3-642-35828-9_21

EvalIta 2011 : The frame labeling over Italian texts task. / Basili, Roberto; De Cao, Diego; Lenci, Alessandro; Moschitti, Alessandro; Venturi, Giulia.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7689 LNAI 2013. p. 195-204 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7689 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Basili, R, De Cao, D, Lenci, A, Moschitti, A & Venturi, G 2013, EvalIta 2011: The frame labeling over Italian texts task. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 7689 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7689 LNAI, pp. 195-204, International Workshop on Evaluation of Natural Language and Speech Tools for Italian, EVALITA 2011, Rome, Italy, 24/1/12. https://doi.org/10.1007/978-3-642-35828-9_21
Basili R, De Cao D, Lenci A, Moschitti A, Venturi G. EvalIta 2011: The frame labeling over Italian texts task. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7689 LNAI. 2013. p. 195-204. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-35828-9_21
Basili, Roberto ; De Cao, Diego ; Lenci, Alessandro ; Moschitti, Alessandro ; Venturi, Giulia. / EvalIta 2011 : The frame labeling over Italian texts task. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7689 LNAI 2013. pp. 195-204 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{69bb03e0261347eebbc03c15d4813967,
title = "EvalIta 2011: The frame labeling over Italian texts task",
abstract = "The Frame Labeling over Italian Texts (FLaIT) task held within the EvalIta 2011 challenge is here described. It focuses on the automatic annotation of free texts according to frame semantics. Systems were asked to label all semantic frames and their arguments, as evoked by predicate words occurring in plain text sentences. Proposed systems are based on a variety of learning techniques and achieve very good results, over 80{\%} of accuracy, in most subtasks.",
keywords = "Frame Semantics, NLP System Evaluation, Shallow Semantic Parsing",
author = "Roberto Basili and {De Cao}, Diego and Alessandro Lenci and Alessandro Moschitti and Giulia Venturi",
year = "2013",
month = "12",
day = "1",
doi = "10.1007/978-3-642-35828-9_21",
language = "English",
isbn = "9783642358272",
volume = "7689 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "195--204",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - EvalIta 2011

T2 - The frame labeling over Italian texts task

AU - Basili, Roberto

AU - De Cao, Diego

AU - Lenci, Alessandro

AU - Moschitti, Alessandro

AU - Venturi, Giulia

PY - 2013/12/1

Y1 - 2013/12/1

N2 - The Frame Labeling over Italian Texts (FLaIT) task held within the EvalIta 2011 challenge is here described. It focuses on the automatic annotation of free texts according to frame semantics. Systems were asked to label all semantic frames and their arguments, as evoked by predicate words occurring in plain text sentences. Proposed systems are based on a variety of learning techniques and achieve very good results, over 80% of accuracy, in most subtasks.

AB - The Frame Labeling over Italian Texts (FLaIT) task held within the EvalIta 2011 challenge is here described. It focuses on the automatic annotation of free texts according to frame semantics. Systems were asked to label all semantic frames and their arguments, as evoked by predicate words occurring in plain text sentences. Proposed systems are based on a variety of learning techniques and achieve very good results, over 80% of accuracy, in most subtasks.

KW - Frame Semantics

KW - NLP System Evaluation

KW - Shallow Semantic Parsing

UR - http://www.scopus.com/inward/record.url?scp=84892841656&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84892841656&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-35828-9_21

DO - 10.1007/978-3-642-35828-9_21

M3 - Conference contribution

AN - SCOPUS:84892841656

SN - 9783642358272

VL - 7689 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 195

EP - 204

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -