DRS: Auto-Scaling for Real-Time Stream Analytics

Tom Z.J. Fu, Jianbing Ding, Richard T.B. Ma, Marianne Winslett, Yin Yang, Zhenjie Zhang

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

In a stream data analytics system, input data arrive continuously and trigger the processing and updating of analytics results. We focus on applications with real-time constraints, in which, any data unit must be completely processed within a given time duration. To handle fast data, it is common to place the stream data analytics system on top of a cloud infrastructure. Because stream properties, such as arrival rates can fluctuate unpredictably, cloud resources must be dynamically provisioned and scheduled accordingly to ensure real-time responses. It is essential, for existing systems or future developments, to possess the ability of scaling resources dynamically according to the instantaneous workload, in order to avoid wasting resources or failing in delivering the correct analytics results on time. Motivated by this, we propose DRS, a dynamic resource scaling framework for cloud-based stream data analytics systems. DRS overcomes three fundamental challenges: 1 how to model the relationship between the provisioned resources and the application performance, 2 where to best place resources, and 3 how to measure the system load with minimal overhead. In particular, DRS includes an accurate performance model based on the theory of Jackson open queueing networks and is capable of handling arbitrary operator topologies, possibly with loops, splits, and joins. Extensive experiments with real data show that DRS is capable of detecting sub-optimal resource allocation and making quick and effective resource adjustment.

Original languageEnglish
Pages (from-to)3338-3352
Number of pages15
JournalIEEE/ACM Transactions on Networking
Volume25
Issue number6
DOIs
Publication statusPublished - 1 Dec 2017

    Fingerprint

Keywords

  • queueing network model
  • resource auto-scaling
  • stream data analytics
  • Termsa-Cloud computing

ASJC Scopus subject areas

  • Software
  • Computer Science Applications
  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Cite this

Fu, T. Z. J., Ding, J., Ma, R. T. B., Winslett, M., Yang, Y., & Zhang, Z. (2017). DRS: Auto-Scaling for Real-Time Stream Analytics. IEEE/ACM Transactions on Networking, 25(6), 3338-3352. https://doi.org/10.1109/TNET.2017.2741969