Chariots

A scalable shared log for data management in multi-datacenter cloud environments

Faisal Nawab, Vaibhav Arora, Divyakant Agrawal, Amr El Abbadi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Web-based applications face unprecedented workloads demanding the processing of a large number of events reaching to the millions per second. That is why developers are increasingly relying on scalable cloud platforms to implement cloud applications. Chariots exposes a shared log to be used by cloud applications. The log is essential for many tasks like bookkeeping, recovery, and debugging. Logs offer linearizability and simple append and read operations of immutable records to facilitate building complex systems like stream processors and transaction managers. As a cloud platform, Chariots offers fault-tolerance, persistence, and high-availability, transparently. Current shared log infrastructures suffer from the bottleneck of serializing log records through a centralized server which limits the throughput to that of a single machine. We propose a novel distributed log store, called the Fractal Log Store (FLStore), that overcomes the bottleneck of a single-point of contention. FLStore maintains the log within the datacenter. We also propose Chariots, which provides multi-datacenter replication for shared logs. In it, FLStore is leveraged as the log store. Chariots maintains causal ordering of records in the log and has a scalable design that allows elastic expansion of resources.

Original languageEnglish
Title of host publicationEDBT 2015 - 18th International Conference on Extending Database Technology, Proceedings
PublisherOpenProceedings.org, University of Konstanz, University Library
Pages13-24
Number of pages12
ISBN (Electronic)9783893180677
DOIs
Publication statusPublished - 2015
Externally publishedYes
Event18th International Conference on Extending Database Technology, EDBT 2015 - Brussels, Belgium
Duration: 23 Mar 201527 Mar 2015

Other

Other18th International Conference on Extending Database Technology, EDBT 2015
CountryBelgium
CityBrussels
Period23/3/1527/3/15

Fingerprint

Fractals
Information management
Fault tolerance
Large scale systems
Managers
Servers
Throughput
Availability
Recovery
Processing

ASJC Scopus subject areas

  • Information Systems
  • Software

Cite this

Nawab, F., Arora, V., Agrawal, D., & El Abbadi, A. (2015). Chariots: A scalable shared log for data management in multi-datacenter cloud environments. In EDBT 2015 - 18th International Conference on Extending Database Technology, Proceedings (pp. 13-24). OpenProceedings.org, University of Konstanz, University Library. https://doi.org/10.5441/002/edbt.2015.03

Chariots : A scalable shared log for data management in multi-datacenter cloud environments. / Nawab, Faisal; Arora, Vaibhav; Agrawal, Divyakant; El Abbadi, Amr.

EDBT 2015 - 18th International Conference on Extending Database Technology, Proceedings. OpenProceedings.org, University of Konstanz, University Library, 2015. p. 13-24.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nawab, F, Arora, V, Agrawal, D & El Abbadi, A 2015, Chariots: A scalable shared log for data management in multi-datacenter cloud environments. in EDBT 2015 - 18th International Conference on Extending Database Technology, Proceedings. OpenProceedings.org, University of Konstanz, University Library, pp. 13-24, 18th International Conference on Extending Database Technology, EDBT 2015, Brussels, Belgium, 23/3/15. https://doi.org/10.5441/002/edbt.2015.03
Nawab F, Arora V, Agrawal D, El Abbadi A. Chariots: A scalable shared log for data management in multi-datacenter cloud environments. In EDBT 2015 - 18th International Conference on Extending Database Technology, Proceedings. OpenProceedings.org, University of Konstanz, University Library. 2015. p. 13-24 https://doi.org/10.5441/002/edbt.2015.03
Nawab, Faisal ; Arora, Vaibhav ; Agrawal, Divyakant ; El Abbadi, Amr. / Chariots : A scalable shared log for data management in multi-datacenter cloud environments. EDBT 2015 - 18th International Conference on Extending Database Technology, Proceedings. OpenProceedings.org, University of Konstanz, University Library, 2015. pp. 13-24
@inproceedings{58bc49b66d9d46318ee036068d6d3aa3,
title = "Chariots: A scalable shared log for data management in multi-datacenter cloud environments",
abstract = "Web-based applications face unprecedented workloads demanding the processing of a large number of events reaching to the millions per second. That is why developers are increasingly relying on scalable cloud platforms to implement cloud applications. Chariots exposes a shared log to be used by cloud applications. The log is essential for many tasks like bookkeeping, recovery, and debugging. Logs offer linearizability and simple append and read operations of immutable records to facilitate building complex systems like stream processors and transaction managers. As a cloud platform, Chariots offers fault-tolerance, persistence, and high-availability, transparently. Current shared log infrastructures suffer from the bottleneck of serializing log records through a centralized server which limits the throughput to that of a single machine. We propose a novel distributed log store, called the Fractal Log Store (FLStore), that overcomes the bottleneck of a single-point of contention. FLStore maintains the log within the datacenter. We also propose Chariots, which provides multi-datacenter replication for shared logs. In it, FLStore is leveraged as the log store. Chariots maintains causal ordering of records in the log and has a scalable design that allows elastic expansion of resources.",
author = "Faisal Nawab and Vaibhav Arora and Divyakant Agrawal and {El Abbadi}, Amr",
year = "2015",
doi = "10.5441/002/edbt.2015.03",
language = "English",
pages = "13--24",
booktitle = "EDBT 2015 - 18th International Conference on Extending Database Technology, Proceedings",
publisher = "OpenProceedings.org, University of Konstanz, University Library",

}

TY - GEN

T1 - Chariots

T2 - A scalable shared log for data management in multi-datacenter cloud environments

AU - Nawab, Faisal

AU - Arora, Vaibhav

AU - Agrawal, Divyakant

AU - El Abbadi, Amr

PY - 2015

Y1 - 2015

N2 - Web-based applications face unprecedented workloads demanding the processing of a large number of events reaching to the millions per second. That is why developers are increasingly relying on scalable cloud platforms to implement cloud applications. Chariots exposes a shared log to be used by cloud applications. The log is essential for many tasks like bookkeeping, recovery, and debugging. Logs offer linearizability and simple append and read operations of immutable records to facilitate building complex systems like stream processors and transaction managers. As a cloud platform, Chariots offers fault-tolerance, persistence, and high-availability, transparently. Current shared log infrastructures suffer from the bottleneck of serializing log records through a centralized server which limits the throughput to that of a single machine. We propose a novel distributed log store, called the Fractal Log Store (FLStore), that overcomes the bottleneck of a single-point of contention. FLStore maintains the log within the datacenter. We also propose Chariots, which provides multi-datacenter replication for shared logs. In it, FLStore is leveraged as the log store. Chariots maintains causal ordering of records in the log and has a scalable design that allows elastic expansion of resources.

AB - Web-based applications face unprecedented workloads demanding the processing of a large number of events reaching to the millions per second. That is why developers are increasingly relying on scalable cloud platforms to implement cloud applications. Chariots exposes a shared log to be used by cloud applications. The log is essential for many tasks like bookkeeping, recovery, and debugging. Logs offer linearizability and simple append and read operations of immutable records to facilitate building complex systems like stream processors and transaction managers. As a cloud platform, Chariots offers fault-tolerance, persistence, and high-availability, transparently. Current shared log infrastructures suffer from the bottleneck of serializing log records through a centralized server which limits the throughput to that of a single machine. We propose a novel distributed log store, called the Fractal Log Store (FLStore), that overcomes the bottleneck of a single-point of contention. FLStore maintains the log within the datacenter. We also propose Chariots, which provides multi-datacenter replication for shared logs. In it, FLStore is leveraged as the log store. Chariots maintains causal ordering of records in the log and has a scalable design that allows elastic expansion of resources.

UR - http://www.scopus.com/inward/record.url?scp=84976314213&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84976314213&partnerID=8YFLogxK

U2 - 10.5441/002/edbt.2015.03

DO - 10.5441/002/edbt.2015.03

M3 - Conference contribution

SP - 13

EP - 24

BT - EDBT 2015 - 18th International Conference on Extending Database Technology, Proceedings

PB - OpenProceedings.org, University of Konstanz, University Library

ER -