Online piece-wise linear approximation of numerical streams with precision guarantees

Hazem Elmeleegy, Ahmed Elmagarmid, Emmanuel Cecchet, Walid G. Aref, Willy Zwaenepoel

Research output: Chapter in Book/Report/Conference proceedingChapter

34 Citations (Scopus)

Abstract

Continuous "always-on" monitoring is beneficial for a number of applications, but potentially imposes a high load in terms of communication, storage and power consumption when a large number of variables need to be monitored. We introduce two new filtering techniques, swing filters and slide filters, that represent within a prescribed precision a time-varying numerical signal by a piecewise linear function, consisting of connected line segments for swing filters and (mostly) disconnected line segments for slide filters. We demonstrate the effectiveness of swing and slide filters in terms of their compression power by applying them to a reallife data set plus a variety of synthetic data sets. For nearly all combinations of signal behavior and precision requirements, the proposed techniques outperform the earlier approaches for online filtering in terms of data reduction. The slide filter, in particular, consistently dominates all other filters, with up to twofold improvement over the best of the previous techniques.

Original languageEnglish
Title of host publicationProceedings of the VLDB Endowment
Pages145-156
Number of pages12
Volume2
Edition1
Publication statusPublished - 2009
Externally publishedYes

Fingerprint

Data reduction
Electric power utilization
Monitoring
Communication

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Computer Science(all)

Cite this

Elmeleegy, H., Elmagarmid, A., Cecchet, E., Aref, W. G., & Zwaenepoel, W. (2009). Online piece-wise linear approximation of numerical streams with precision guarantees. In Proceedings of the VLDB Endowment (1 ed., Vol. 2, pp. 145-156)

Online piece-wise linear approximation of numerical streams with precision guarantees. / Elmeleegy, Hazem; Elmagarmid, Ahmed; Cecchet, Emmanuel; Aref, Walid G.; Zwaenepoel, Willy.

Proceedings of the VLDB Endowment. Vol. 2 1. ed. 2009. p. 145-156.

Research output: Chapter in Book/Report/Conference proceedingChapter

Elmeleegy, H, Elmagarmid, A, Cecchet, E, Aref, WG & Zwaenepoel, W 2009, Online piece-wise linear approximation of numerical streams with precision guarantees. in Proceedings of the VLDB Endowment. 1 edn, vol. 2, pp. 145-156.
Elmeleegy H, Elmagarmid A, Cecchet E, Aref WG, Zwaenepoel W. Online piece-wise linear approximation of numerical streams with precision guarantees. In Proceedings of the VLDB Endowment. 1 ed. Vol. 2. 2009. p. 145-156
Elmeleegy, Hazem ; Elmagarmid, Ahmed ; Cecchet, Emmanuel ; Aref, Walid G. ; Zwaenepoel, Willy. / Online piece-wise linear approximation of numerical streams with precision guarantees. Proceedings of the VLDB Endowment. Vol. 2 1. ed. 2009. pp. 145-156
@inbook{ecb5b37060cb4995ab7da809fc3d29b6,
title = "Online piece-wise linear approximation of numerical streams with precision guarantees",
abstract = "Continuous {"}always-on{"} monitoring is beneficial for a number of applications, but potentially imposes a high load in terms of communication, storage and power consumption when a large number of variables need to be monitored. We introduce two new filtering techniques, swing filters and slide filters, that represent within a prescribed precision a time-varying numerical signal by a piecewise linear function, consisting of connected line segments for swing filters and (mostly) disconnected line segments for slide filters. We demonstrate the effectiveness of swing and slide filters in terms of their compression power by applying them to a reallife data set plus a variety of synthetic data sets. For nearly all combinations of signal behavior and precision requirements, the proposed techniques outperform the earlier approaches for online filtering in terms of data reduction. The slide filter, in particular, consistently dominates all other filters, with up to twofold improvement over the best of the previous techniques.",
author = "Hazem Elmeleegy and Ahmed Elmagarmid and Emmanuel Cecchet and Aref, {Walid G.} and Willy Zwaenepoel",
year = "2009",
language = "English",
volume = "2",
pages = "145--156",
booktitle = "Proceedings of the VLDB Endowment",
edition = "1",

}

TY - CHAP

T1 - Online piece-wise linear approximation of numerical streams with precision guarantees

AU - Elmeleegy, Hazem

AU - Elmagarmid, Ahmed

AU - Cecchet, Emmanuel

AU - Aref, Walid G.

AU - Zwaenepoel, Willy

PY - 2009

Y1 - 2009

N2 - Continuous "always-on" monitoring is beneficial for a number of applications, but potentially imposes a high load in terms of communication, storage and power consumption when a large number of variables need to be monitored. We introduce two new filtering techniques, swing filters and slide filters, that represent within a prescribed precision a time-varying numerical signal by a piecewise linear function, consisting of connected line segments for swing filters and (mostly) disconnected line segments for slide filters. We demonstrate the effectiveness of swing and slide filters in terms of their compression power by applying them to a reallife data set plus a variety of synthetic data sets. For nearly all combinations of signal behavior and precision requirements, the proposed techniques outperform the earlier approaches for online filtering in terms of data reduction. The slide filter, in particular, consistently dominates all other filters, with up to twofold improvement over the best of the previous techniques.

AB - Continuous "always-on" monitoring is beneficial for a number of applications, but potentially imposes a high load in terms of communication, storage and power consumption when a large number of variables need to be monitored. We introduce two new filtering techniques, swing filters and slide filters, that represent within a prescribed precision a time-varying numerical signal by a piecewise linear function, consisting of connected line segments for swing filters and (mostly) disconnected line segments for slide filters. We demonstrate the effectiveness of swing and slide filters in terms of their compression power by applying them to a reallife data set plus a variety of synthetic data sets. For nearly all combinations of signal behavior and precision requirements, the proposed techniques outperform the earlier approaches for online filtering in terms of data reduction. The slide filter, in particular, consistently dominates all other filters, with up to twofold improvement over the best of the previous techniques.

UR - http://www.scopus.com/inward/record.url?scp=80052490550&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80052490550&partnerID=8YFLogxK

M3 - Chapter

VL - 2

SP - 145

EP - 156

BT - Proceedings of the VLDB Endowment

ER -