JISC

Adaptive stream processing using just-in-time state completion?

Ahmed M. Aly, Walid G. Aref, Mourad Ouzzani, Hosam M. Mahmoud

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

The continuous and dynamic nature of data streams may lead a query execution plan (QEP) of a long-running continuous query to become suboptimal during execution, and hence will need to be altered. The ability to perform an efficient and flawless transition to an equivalent, yet optimal QEP is essential for a data stream query processor. Such transition is challenging for plans with stateful binary operators, such as joins, where the states of the QEP have to be maintained during query transition without compromising the correctness of the query output. This paper presents Just-In-Time State Completion (JISC); a new technique for query plan migration. JISC does not cause any halt to the query execution, and thus allows the query to maintain steady output. JISC is applicable to pipelined as well as eddy-based query evaluation frameworks. Probabilistic analysis of the cost and experimental studies show that JISC increases the execution throughput during the plan migration stage by up to an order of magnitude compared to existing solutions.

Original languageEnglish
Title of host publicationAdvances in Database Technology - EDBT 2014: 17th International Conference on Extending Database Technology, Proceedings
PublisherOpenProceedings.org, University of Konstanz, University Library
Pages73-84
Number of pages12
ISBN (Electronic)9783893180653
DOIs
Publication statusPublished - 2014
Event17th International Conference on Extending Database Technology, EDBT 2014 - Athens, Greece
Duration: 24 Mar 201428 Mar 2014

Other

Other17th International Conference on Extending Database Technology, EDBT 2014
CountryGreece
CityAthens
Period24/3/1428/3/14

Fingerprint

Throughput
Processing
Costs

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems
  • Software

Cite this

Aly, A. M., Aref, W. G., Ouzzani, M., & Mahmoud, H. M. (2014). JISC: Adaptive stream processing using just-in-time state completion? In Advances in Database Technology - EDBT 2014: 17th International Conference on Extending Database Technology, Proceedings (pp. 73-84). OpenProceedings.org, University of Konstanz, University Library. https://doi.org/10.5441/002/edbt.2014.08

JISC : Adaptive stream processing using just-in-time state completion? / Aly, Ahmed M.; Aref, Walid G.; Ouzzani, Mourad; Mahmoud, Hosam M.

Advances in Database Technology - EDBT 2014: 17th International Conference on Extending Database Technology, Proceedings. OpenProceedings.org, University of Konstanz, University Library, 2014. p. 73-84.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Aly, AM, Aref, WG, Ouzzani, M & Mahmoud, HM 2014, JISC: Adaptive stream processing using just-in-time state completion? in Advances in Database Technology - EDBT 2014: 17th International Conference on Extending Database Technology, Proceedings. OpenProceedings.org, University of Konstanz, University Library, pp. 73-84, 17th International Conference on Extending Database Technology, EDBT 2014, Athens, Greece, 24/3/14. https://doi.org/10.5441/002/edbt.2014.08
Aly AM, Aref WG, Ouzzani M, Mahmoud HM. JISC: Adaptive stream processing using just-in-time state completion? In Advances in Database Technology - EDBT 2014: 17th International Conference on Extending Database Technology, Proceedings. OpenProceedings.org, University of Konstanz, University Library. 2014. p. 73-84 https://doi.org/10.5441/002/edbt.2014.08
Aly, Ahmed M. ; Aref, Walid G. ; Ouzzani, Mourad ; Mahmoud, Hosam M. / JISC : Adaptive stream processing using just-in-time state completion?. Advances in Database Technology - EDBT 2014: 17th International Conference on Extending Database Technology, Proceedings. OpenProceedings.org, University of Konstanz, University Library, 2014. pp. 73-84
@inproceedings{24a72007273144588edb453c889a9988,
title = "JISC: Adaptive stream processing using just-in-time state completion?",
abstract = "The continuous and dynamic nature of data streams may lead a query execution plan (QEP) of a long-running continuous query to become suboptimal during execution, and hence will need to be altered. The ability to perform an efficient and flawless transition to an equivalent, yet optimal QEP is essential for a data stream query processor. Such transition is challenging for plans with stateful binary operators, such as joins, where the states of the QEP have to be maintained during query transition without compromising the correctness of the query output. This paper presents Just-In-Time State Completion (JISC); a new technique for query plan migration. JISC does not cause any halt to the query execution, and thus allows the query to maintain steady output. JISC is applicable to pipelined as well as eddy-based query evaluation frameworks. Probabilistic analysis of the cost and experimental studies show that JISC increases the execution throughput during the plan migration stage by up to an order of magnitude compared to existing solutions.",
author = "Aly, {Ahmed M.} and Aref, {Walid G.} and Mourad Ouzzani and Mahmoud, {Hosam M.}",
year = "2014",
doi = "10.5441/002/edbt.2014.08",
language = "English",
pages = "73--84",
booktitle = "Advances in Database Technology - EDBT 2014: 17th International Conference on Extending Database Technology, Proceedings",
publisher = "OpenProceedings.org, University of Konstanz, University Library",

}

TY - GEN

T1 - JISC

T2 - Adaptive stream processing using just-in-time state completion?

AU - Aly, Ahmed M.

AU - Aref, Walid G.

AU - Ouzzani, Mourad

AU - Mahmoud, Hosam M.

PY - 2014

Y1 - 2014

N2 - The continuous and dynamic nature of data streams may lead a query execution plan (QEP) of a long-running continuous query to become suboptimal during execution, and hence will need to be altered. The ability to perform an efficient and flawless transition to an equivalent, yet optimal QEP is essential for a data stream query processor. Such transition is challenging for plans with stateful binary operators, such as joins, where the states of the QEP have to be maintained during query transition without compromising the correctness of the query output. This paper presents Just-In-Time State Completion (JISC); a new technique for query plan migration. JISC does not cause any halt to the query execution, and thus allows the query to maintain steady output. JISC is applicable to pipelined as well as eddy-based query evaluation frameworks. Probabilistic analysis of the cost and experimental studies show that JISC increases the execution throughput during the plan migration stage by up to an order of magnitude compared to existing solutions.

AB - The continuous and dynamic nature of data streams may lead a query execution plan (QEP) of a long-running continuous query to become suboptimal during execution, and hence will need to be altered. The ability to perform an efficient and flawless transition to an equivalent, yet optimal QEP is essential for a data stream query processor. Such transition is challenging for plans with stateful binary operators, such as joins, where the states of the QEP have to be maintained during query transition without compromising the correctness of the query output. This paper presents Just-In-Time State Completion (JISC); a new technique for query plan migration. JISC does not cause any halt to the query execution, and thus allows the query to maintain steady output. JISC is applicable to pipelined as well as eddy-based query evaluation frameworks. Probabilistic analysis of the cost and experimental studies show that JISC increases the execution throughput during the plan migration stage by up to an order of magnitude compared to existing solutions.

UR - http://www.scopus.com/inward/record.url?scp=84964419581&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84964419581&partnerID=8YFLogxK

U2 - 10.5441/002/edbt.2014.08

DO - 10.5441/002/edbt.2014.08

M3 - Conference contribution

SP - 73

EP - 84

BT - Advances in Database Technology - EDBT 2014: 17th International Conference on Extending Database Technology, Proceedings

PB - OpenProceedings.org, University of Konstanz, University Library

ER -