Effective kernelized online learning in language processing tasks

Simone Filice, Giuseppe Castellucci, Danilo Croce, Roberto Basili

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Kernel-based methods for NLP tasks have been shown to enable robust and effective learning, although their inherent complexity is manifest also in Online Learning (OL) scenarios, where time and memory usage grows along with the arrival of new examples. A state-of-the-art budgeted OL algorithm is here extended to efficiently integrate complex kernels by constraining the overall complexity. Principles of Fairness and Weight Adjustment are applied to mitigate imbalance in data and improve the model stability. Results in Sentiment Analysis in Twitter and Question Classification show that performances very close to the state-of-the-art achieved by batch algorithms can be obtained.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer Verlag
Pages347-358
Number of pages12
Volume8416 LNCS
ISBN (Print)9783319060279
DOIs
Publication statusPublished - 2014
Externally publishedYes
Event36th European Conference on Information Retrieval, ECIR 2014 - Amsterdam
Duration: 13 Apr 201416 Apr 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8416 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other36th European Conference on Information Retrieval, ECIR 2014
CityAmsterdam
Period13/4/1416/4/14

Fingerprint

Online Learning
Learning algorithms
kernel
Sentiment Analysis
Data storage equipment
Online Algorithms
Processing
Fairness
Batch
Learning Algorithm
Adjustment
Integrate
Scenarios
Language
Model
Learning

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Filice, S., Castellucci, G., Croce, D., & Basili, R. (2014). Effective kernelized online learning in language processing tasks. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 8416 LNCS, pp. 347-358). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8416 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-06028-6_29

Effective kernelized online learning in language processing tasks. / Filice, Simone; Castellucci, Giuseppe; Croce, Danilo; Basili, Roberto.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8416 LNCS Springer Verlag, 2014. p. 347-358 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8416 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Filice, S, Castellucci, G, Croce, D & Basili, R 2014, Effective kernelized online learning in language processing tasks. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 8416 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8416 LNCS, Springer Verlag, pp. 347-358, 36th European Conference on Information Retrieval, ECIR 2014, Amsterdam, 13/4/14. https://doi.org/10.1007/978-3-319-06028-6_29
Filice S, Castellucci G, Croce D, Basili R. Effective kernelized online learning in language processing tasks. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8416 LNCS. Springer Verlag. 2014. p. 347-358. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-06028-6_29
Filice, Simone ; Castellucci, Giuseppe ; Croce, Danilo ; Basili, Roberto. / Effective kernelized online learning in language processing tasks. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8416 LNCS Springer Verlag, 2014. pp. 347-358 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{ed77bf55718e410c9eefcbf752e9056a,
title = "Effective kernelized online learning in language processing tasks",
abstract = "Kernel-based methods for NLP tasks have been shown to enable robust and effective learning, although their inherent complexity is manifest also in Online Learning (OL) scenarios, where time and memory usage grows along with the arrival of new examples. A state-of-the-art budgeted OL algorithm is here extended to efficiently integrate complex kernels by constraining the overall complexity. Principles of Fairness and Weight Adjustment are applied to mitigate imbalance in data and improve the model stability. Results in Sentiment Analysis in Twitter and Question Classification show that performances very close to the state-of-the-art achieved by batch algorithms can be obtained.",
author = "Simone Filice and Giuseppe Castellucci and Danilo Croce and Roberto Basili",
year = "2014",
doi = "10.1007/978-3-319-06028-6_29",
language = "English",
isbn = "9783319060279",
volume = "8416 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "347--358",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Effective kernelized online learning in language processing tasks

AU - Filice, Simone

AU - Castellucci, Giuseppe

AU - Croce, Danilo

AU - Basili, Roberto

PY - 2014

Y1 - 2014

N2 - Kernel-based methods for NLP tasks have been shown to enable robust and effective learning, although their inherent complexity is manifest also in Online Learning (OL) scenarios, where time and memory usage grows along with the arrival of new examples. A state-of-the-art budgeted OL algorithm is here extended to efficiently integrate complex kernels by constraining the overall complexity. Principles of Fairness and Weight Adjustment are applied to mitigate imbalance in data and improve the model stability. Results in Sentiment Analysis in Twitter and Question Classification show that performances very close to the state-of-the-art achieved by batch algorithms can be obtained.

AB - Kernel-based methods for NLP tasks have been shown to enable robust and effective learning, although their inherent complexity is manifest also in Online Learning (OL) scenarios, where time and memory usage grows along with the arrival of new examples. A state-of-the-art budgeted OL algorithm is here extended to efficiently integrate complex kernels by constraining the overall complexity. Principles of Fairness and Weight Adjustment are applied to mitigate imbalance in data and improve the model stability. Results in Sentiment Analysis in Twitter and Question Classification show that performances very close to the state-of-the-art achieved by batch algorithms can be obtained.

UR - http://www.scopus.com/inward/record.url?scp=84899919593&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84899919593&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-06028-6_29

DO - 10.1007/978-3-319-06028-6_29

M3 - Conference contribution

AN - SCOPUS:84899919593

SN - 9783319060279

VL - 8416 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 347

EP - 358

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer Verlag

ER -