A demonstration of ST-Hadoop: A MapReduce framework for big spatio-temporal data

Louai Alarabi, Mohamed Mokbel

Research output: Contribution to journalConference article

6 Citations (Scopus)

Abstract

This demo presents ST-Hadoop; the first full-fledged open-source MapReduce framework with a native support for spatio-temporal data. ST-Hadoop injects spatio-temporal awareness in the Hadoop base code, which results in achieving order(s) of magnitude better performance than Hadoop and SpatialHadoop when dealing with spatio-temporal data and queries. The key idea behind ST-Hadoop is its ability in indexing spatio-temporal data within Hadoop Distributed File System (HDFS). A real system prototype of STHadoop, running on a local cluster of 24 machines, is demonstrated with two big-spatio-temporal datasets of Twitter and NYC Taxi data, each of around one billion records.

Original languageEnglish
Pages (from-to)1961-1964
Number of pages4
JournalProceedings of the VLDB Endowment
Volume10
Issue number12
Publication statusPublished - 1 Aug 2017
Externally publishedYes

Fingerprint

Demonstrations

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Computer Science(all)

Cite this

A demonstration of ST-Hadoop : A MapReduce framework for big spatio-temporal data. / Alarabi, Louai; Mokbel, Mohamed.

In: Proceedings of the VLDB Endowment, Vol. 10, No. 12, 01.08.2017, p. 1961-1964.

Research output: Contribution to journalConference article

@article{55ff4c3c8fc342a69e55813b5ef0e776,
title = "A demonstration of ST-Hadoop: A MapReduce framework for big spatio-temporal data",
abstract = "This demo presents ST-Hadoop; the first full-fledged open-source MapReduce framework with a native support for spatio-temporal data. ST-Hadoop injects spatio-temporal awareness in the Hadoop base code, which results in achieving order(s) of magnitude better performance than Hadoop and SpatialHadoop when dealing with spatio-temporal data and queries. The key idea behind ST-Hadoop is its ability in indexing spatio-temporal data within Hadoop Distributed File System (HDFS). A real system prototype of STHadoop, running on a local cluster of 24 machines, is demonstrated with two big-spatio-temporal datasets of Twitter and NYC Taxi data, each of around one billion records.",
author = "Louai Alarabi and Mohamed Mokbel",
year = "2017",
month = "8",
day = "1",
language = "English",
volume = "10",
pages = "1961--1964",
journal = "Proceedings of the VLDB Endowment",
issn = "2150-8097",
publisher = "Very Large Data Base Endowment Inc.",
number = "12",

}

TY - JOUR

T1 - A demonstration of ST-Hadoop

T2 - A MapReduce framework for big spatio-temporal data

AU - Alarabi, Louai

AU - Mokbel, Mohamed

PY - 2017/8/1

Y1 - 2017/8/1

N2 - This demo presents ST-Hadoop; the first full-fledged open-source MapReduce framework with a native support for spatio-temporal data. ST-Hadoop injects spatio-temporal awareness in the Hadoop base code, which results in achieving order(s) of magnitude better performance than Hadoop and SpatialHadoop when dealing with spatio-temporal data and queries. The key idea behind ST-Hadoop is its ability in indexing spatio-temporal data within Hadoop Distributed File System (HDFS). A real system prototype of STHadoop, running on a local cluster of 24 machines, is demonstrated with two big-spatio-temporal datasets of Twitter and NYC Taxi data, each of around one billion records.

AB - This demo presents ST-Hadoop; the first full-fledged open-source MapReduce framework with a native support for spatio-temporal data. ST-Hadoop injects spatio-temporal awareness in the Hadoop base code, which results in achieving order(s) of magnitude better performance than Hadoop and SpatialHadoop when dealing with spatio-temporal data and queries. The key idea behind ST-Hadoop is its ability in indexing spatio-temporal data within Hadoop Distributed File System (HDFS). A real system prototype of STHadoop, running on a local cluster of 24 machines, is demonstrated with two big-spatio-temporal datasets of Twitter and NYC Taxi data, each of around one billion records.

UR - http://www.scopus.com/inward/record.url?scp=85036622388&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85036622388&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85036622388

VL - 10

SP - 1961

EP - 1964

JO - Proceedings of the VLDB Endowment

JF - Proceedings of the VLDB Endowment

SN - 2150-8097

IS - 12

ER -