Dynamic plan migration for snapshot-equivalent continuous queries in data stream systems

Jürgen Krämer, Yin Yang, Michael Cammert, Bernhard Seeger, Dimitris Papadias

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

A data stream management system executes a large number of continuous queries in parallel. As stream characteristics and query workload change over time, the plan initially installed for a continuous query may become inefficient. As a consequence, the query optimizer will re-optimize this plan based on the current statistics. The replacement of the running plan with a more efficient but semantically equivalent plan at runtime is called dynamic plan migration. In order to have a sound semantic foundation for query optimization, we investigate dynamic plan migration for snapshot-equivalent plans. We develop a general method for dynamic plan migration that treats the old and new plan as snapshot-equivalent black boxes. This enables the query optimizer to apply the conventional transformation rules during re-optimization. As a consequence, our approach supports the dynamic optimization of arbitrary continuous queries expressible in CQL, whereas existing solutions are limited in their scope.

Original languageEnglish
Title of host publicationCurrent Trends in Database Technology - EDBT 2006 - EDBT 2006 Workshops PhD, DataX, IIDB, IIHA, ICSNW, QLQP, PIM, PaRMA, and Reactivity on the Web, Revised Selected Papers
PublisherSpringer Verlag
Pages497-516
Number of pages20
Volume4254 LNCS
ISBN (Print)3540467882, 9783540467885
Publication statusPublished - 2006
Externally publishedYes
Event10th International Conference on Extending Database Technology, EDBT 2006 - Munich, Germany
Duration: 26 Mar 200631 Mar 2006

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4254 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other10th International Conference on Extending Database Technology, EDBT 2006
CountryGermany
CityMunich
Period26/3/0631/3/06

Fingerprint

Continuous Queries
Snapshot
Data Streams
Migration
Query
Semantics
Statistics
Acoustic waves
Reoptimization
Query Optimization
Dynamic Optimization
Black Box
Replacement
Workload
Optimise

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Krämer, J., Yang, Y., Cammert, M., Seeger, B., & Papadias, D. (2006). Dynamic plan migration for snapshot-equivalent continuous queries in data stream systems. In Current Trends in Database Technology - EDBT 2006 - EDBT 2006 Workshops PhD, DataX, IIDB, IIHA, ICSNW, QLQP, PIM, PaRMA, and Reactivity on the Web, Revised Selected Papers (Vol. 4254 LNCS, pp. 497-516). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4254 LNCS). Springer Verlag.

Dynamic plan migration for snapshot-equivalent continuous queries in data stream systems. / Krämer, Jürgen; Yang, Yin; Cammert, Michael; Seeger, Bernhard; Papadias, Dimitris.

Current Trends in Database Technology - EDBT 2006 - EDBT 2006 Workshops PhD, DataX, IIDB, IIHA, ICSNW, QLQP, PIM, PaRMA, and Reactivity on the Web, Revised Selected Papers. Vol. 4254 LNCS Springer Verlag, 2006. p. 497-516 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4254 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Krämer, J, Yang, Y, Cammert, M, Seeger, B & Papadias, D 2006, Dynamic plan migration for snapshot-equivalent continuous queries in data stream systems. in Current Trends in Database Technology - EDBT 2006 - EDBT 2006 Workshops PhD, DataX, IIDB, IIHA, ICSNW, QLQP, PIM, PaRMA, and Reactivity on the Web, Revised Selected Papers. vol. 4254 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4254 LNCS, Springer Verlag, pp. 497-516, 10th International Conference on Extending Database Technology, EDBT 2006, Munich, Germany, 26/3/06.
Krämer J, Yang Y, Cammert M, Seeger B, Papadias D. Dynamic plan migration for snapshot-equivalent continuous queries in data stream systems. In Current Trends in Database Technology - EDBT 2006 - EDBT 2006 Workshops PhD, DataX, IIDB, IIHA, ICSNW, QLQP, PIM, PaRMA, and Reactivity on the Web, Revised Selected Papers. Vol. 4254 LNCS. Springer Verlag. 2006. p. 497-516. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Krämer, Jürgen ; Yang, Yin ; Cammert, Michael ; Seeger, Bernhard ; Papadias, Dimitris. / Dynamic plan migration for snapshot-equivalent continuous queries in data stream systems. Current Trends in Database Technology - EDBT 2006 - EDBT 2006 Workshops PhD, DataX, IIDB, IIHA, ICSNW, QLQP, PIM, PaRMA, and Reactivity on the Web, Revised Selected Papers. Vol. 4254 LNCS Springer Verlag, 2006. pp. 497-516 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{4442b27879de4400aa5a6dbcec701113,
title = "Dynamic plan migration for snapshot-equivalent continuous queries in data stream systems",
abstract = "A data stream management system executes a large number of continuous queries in parallel. As stream characteristics and query workload change over time, the plan initially installed for a continuous query may become inefficient. As a consequence, the query optimizer will re-optimize this plan based on the current statistics. The replacement of the running plan with a more efficient but semantically equivalent plan at runtime is called dynamic plan migration. In order to have a sound semantic foundation for query optimization, we investigate dynamic plan migration for snapshot-equivalent plans. We develop a general method for dynamic plan migration that treats the old and new plan as snapshot-equivalent black boxes. This enables the query optimizer to apply the conventional transformation rules during re-optimization. As a consequence, our approach supports the dynamic optimization of arbitrary continuous queries expressible in CQL, whereas existing solutions are limited in their scope.",
author = "J{\"u}rgen Kr{\"a}mer and Yin Yang and Michael Cammert and Bernhard Seeger and Dimitris Papadias",
year = "2006",
language = "English",
isbn = "3540467882",
volume = "4254 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "497--516",
booktitle = "Current Trends in Database Technology - EDBT 2006 - EDBT 2006 Workshops PhD, DataX, IIDB, IIHA, ICSNW, QLQP, PIM, PaRMA, and Reactivity on the Web, Revised Selected Papers",

}

TY - GEN

T1 - Dynamic plan migration for snapshot-equivalent continuous queries in data stream systems

AU - Krämer, Jürgen

AU - Yang, Yin

AU - Cammert, Michael

AU - Seeger, Bernhard

AU - Papadias, Dimitris

PY - 2006

Y1 - 2006

N2 - A data stream management system executes a large number of continuous queries in parallel. As stream characteristics and query workload change over time, the plan initially installed for a continuous query may become inefficient. As a consequence, the query optimizer will re-optimize this plan based on the current statistics. The replacement of the running plan with a more efficient but semantically equivalent plan at runtime is called dynamic plan migration. In order to have a sound semantic foundation for query optimization, we investigate dynamic plan migration for snapshot-equivalent plans. We develop a general method for dynamic plan migration that treats the old and new plan as snapshot-equivalent black boxes. This enables the query optimizer to apply the conventional transformation rules during re-optimization. As a consequence, our approach supports the dynamic optimization of arbitrary continuous queries expressible in CQL, whereas existing solutions are limited in their scope.

AB - A data stream management system executes a large number of continuous queries in parallel. As stream characteristics and query workload change over time, the plan initially installed for a continuous query may become inefficient. As a consequence, the query optimizer will re-optimize this plan based on the current statistics. The replacement of the running plan with a more efficient but semantically equivalent plan at runtime is called dynamic plan migration. In order to have a sound semantic foundation for query optimization, we investigate dynamic plan migration for snapshot-equivalent plans. We develop a general method for dynamic plan migration that treats the old and new plan as snapshot-equivalent black boxes. This enables the query optimizer to apply the conventional transformation rules during re-optimization. As a consequence, our approach supports the dynamic optimization of arbitrary continuous queries expressible in CQL, whereas existing solutions are limited in their scope.

UR - http://www.scopus.com/inward/record.url?scp=33845268832&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33845268832&partnerID=8YFLogxK

M3 - Conference contribution

SN - 3540467882

SN - 9783540467885

VL - 4254 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 497

EP - 516

BT - Current Trends in Database Technology - EDBT 2006 - EDBT 2006 Workshops PhD, DataX, IIDB, IIHA, ICSNW, QLQP, PIM, PaRMA, and Reactivity on the Web, Revised Selected Papers

PB - Springer Verlag

ER -