Data management challenges in cloud computing infrastructures

Divyakant Agrawal, Amr El Abbadi, Shyam Antony, Sudipto Das

Research output: Chapter in Book/Report/Conference proceedingConference contribution

46 Citations (Scopus)

Abstract

The challenge of building consistent, available, and scalable data management systems capable of serving petabytes of data for millions of users has confronted the data management research community as well as large internet enterprises. Current proposed solutions to scalable data management, driven primarily by prevalent application requirements, limit consistent access to only the granularity of single objects, rows, or keys, thereby trading off consistency for high scalability and availability. But the growing popularity of "cloud computing", the resulting shift of a large number of internet applications to the cloud, and the quest towards providing data management services in the cloud, has opened up the challenge for designing data management systems that provide consistency guarantees at a granularity larger than single rows and keys. In this paper, we analyze the design choices that allowed modern scalable data management systems to achieve orders of magnitude higher levels of scalability compared to traditional databases. With this understanding, we highlight some design principles for systems providing scalable and consistent data management as a service in the cloud.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages1-10
Number of pages10
Volume5999 LNCS
DOIs
Publication statusPublished - 3 May 2010
Externally publishedYes
Event6th International Workshop on Databases in Networked Information Systems, DNIS 2010 - Aizu-Wakamatsu, Japan
Duration: 29 Mar 201031 Mar 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5999 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other6th International Workshop on Databases in Networked Information Systems, DNIS 2010
CountryJapan
CityAizu-Wakamatsu
Period29/3/1031/3/10

Fingerprint

Cloud computing
Data Management
Cloud Computing
Information management
Infrastructure
Granularity
Scalability
Internet
Availability
Requirements
Industry

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Agrawal, D., El Abbadi, A., Antony, S., & Das, S. (2010). Data management challenges in cloud computing infrastructures. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 5999 LNCS, pp. 1-10). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5999 LNCS). https://doi.org/10.1007/978-3-642-12038-1_1

Data management challenges in cloud computing infrastructures. / Agrawal, Divyakant; El Abbadi, Amr; Antony, Shyam; Das, Sudipto.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5999 LNCS 2010. p. 1-10 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5999 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Agrawal, D, El Abbadi, A, Antony, S & Das, S 2010, Data management challenges in cloud computing infrastructures. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 5999 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5999 LNCS, pp. 1-10, 6th International Workshop on Databases in Networked Information Systems, DNIS 2010, Aizu-Wakamatsu, Japan, 29/3/10. https://doi.org/10.1007/978-3-642-12038-1_1
Agrawal D, El Abbadi A, Antony S, Das S. Data management challenges in cloud computing infrastructures. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5999 LNCS. 2010. p. 1-10. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-12038-1_1
Agrawal, Divyakant ; El Abbadi, Amr ; Antony, Shyam ; Das, Sudipto. / Data management challenges in cloud computing infrastructures. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5999 LNCS 2010. pp. 1-10 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{213f6e371acf448ea4582f7729751510,
title = "Data management challenges in cloud computing infrastructures",
abstract = "The challenge of building consistent, available, and scalable data management systems capable of serving petabytes of data for millions of users has confronted the data management research community as well as large internet enterprises. Current proposed solutions to scalable data management, driven primarily by prevalent application requirements, limit consistent access to only the granularity of single objects, rows, or keys, thereby trading off consistency for high scalability and availability. But the growing popularity of {"}cloud computing{"}, the resulting shift of a large number of internet applications to the cloud, and the quest towards providing data management services in the cloud, has opened up the challenge for designing data management systems that provide consistency guarantees at a granularity larger than single rows and keys. In this paper, we analyze the design choices that allowed modern scalable data management systems to achieve orders of magnitude higher levels of scalability compared to traditional databases. With this understanding, we highlight some design principles for systems providing scalable and consistent data management as a service in the cloud.",
author = "Divyakant Agrawal and {El Abbadi}, Amr and Shyam Antony and Sudipto Das",
year = "2010",
month = "5",
day = "3",
doi = "10.1007/978-3-642-12038-1_1",
language = "English",
isbn = "3642120377",
volume = "5999 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "1--10",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Data management challenges in cloud computing infrastructures

AU - Agrawal, Divyakant

AU - El Abbadi, Amr

AU - Antony, Shyam

AU - Das, Sudipto

PY - 2010/5/3

Y1 - 2010/5/3

N2 - The challenge of building consistent, available, and scalable data management systems capable of serving petabytes of data for millions of users has confronted the data management research community as well as large internet enterprises. Current proposed solutions to scalable data management, driven primarily by prevalent application requirements, limit consistent access to only the granularity of single objects, rows, or keys, thereby trading off consistency for high scalability and availability. But the growing popularity of "cloud computing", the resulting shift of a large number of internet applications to the cloud, and the quest towards providing data management services in the cloud, has opened up the challenge for designing data management systems that provide consistency guarantees at a granularity larger than single rows and keys. In this paper, we analyze the design choices that allowed modern scalable data management systems to achieve orders of magnitude higher levels of scalability compared to traditional databases. With this understanding, we highlight some design principles for systems providing scalable and consistent data management as a service in the cloud.

AB - The challenge of building consistent, available, and scalable data management systems capable of serving petabytes of data for millions of users has confronted the data management research community as well as large internet enterprises. Current proposed solutions to scalable data management, driven primarily by prevalent application requirements, limit consistent access to only the granularity of single objects, rows, or keys, thereby trading off consistency for high scalability and availability. But the growing popularity of "cloud computing", the resulting shift of a large number of internet applications to the cloud, and the quest towards providing data management services in the cloud, has opened up the challenge for designing data management systems that provide consistency guarantees at a granularity larger than single rows and keys. In this paper, we analyze the design choices that allowed modern scalable data management systems to achieve orders of magnitude higher levels of scalability compared to traditional databases. With this understanding, we highlight some design principles for systems providing scalable and consistent data management as a service in the cloud.

UR - http://www.scopus.com/inward/record.url?scp=77951604529&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77951604529&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-12038-1_1

DO - 10.1007/978-3-642-12038-1_1

M3 - Conference contribution

AN - SCOPUS:77951604529

SN - 3642120377

SN - 9783642120374

VL - 5999 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 1

EP - 10

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -