A demonstration of Shahed

A MapReduce-based system for querying and visualizing satellite data

Ahmed Eldawy, Saif Alharthi, Abdulhadi Alzaidy, Anas Daghistani, Sohaib Ghani, Saleh Basalamah, Mohamed Mokbel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

Several space agencies such as NASA are continuously collecting datasets of earth dynamics - e.g., temperature, vegetation, and cloud coverage - through satellites. This data is stored in a publicly available archive for scientists and researchers and is very useful for studying climate, desertification, and land use change. The benefit of this data comes from its richness as it provides an archived history for over 15 years of satellite observations. Unfortunately, the use of such data is very limited due to the huge size of archives (> 500TB) and the limited capabilities of traditional applications. In this demo, we present Shahed, an interactive system which provides an efficient way to index, query, and visualize satellite datasets available in NASA archive. Shahed is composed of four main modules. The uncertainty module resolves data uncertainty imposed by the satellites. The indexing module organizes the data in a novel multi-resolution spatio-temporal index designed for satellite data. The querying module uses the indexes to answer both spatiotemporal selection and aggregate queries provided by the user. The visualization module generates images, videos, and multi-level images which gives an insight of data distribution and dynamics over time. This demo gives users a hands-on experience with Shahed through a map-based web interface in which users can browse the available datasets using the map, issue spatiotemporal queries, and visualize the results as images or videos.

Original languageEnglish
Title of host publication2015 IEEE 31st International Conference on Data Engineering, ICDE 2015
PublisherIEEE Computer Society
Pages1444-1447
Number of pages4
Volume2015-May
ISBN (Electronic)9781479979639
DOIs
Publication statusPublished - 1 Jan 2015
Externally publishedYes
Event2015 31st IEEE International Conference on Data Engineering, ICDE 2015 - Seoul, Korea, Republic of
Duration: 13 Apr 201517 Apr 2015

Other

Other2015 31st IEEE International Conference on Data Engineering, ICDE 2015
CountryKorea, Republic of
CitySeoul
Period13/4/1517/4/15

Fingerprint

Demonstrations
Satellites
NASA
Land use
Visualization
Earth (planet)
Temperature
Uncertainty

ASJC Scopus subject areas

  • Information Systems
  • Signal Processing
  • Software

Cite this

Eldawy, A., Alharthi, S., Alzaidy, A., Daghistani, A., Ghani, S., Basalamah, S., & Mokbel, M. (2015). A demonstration of Shahed: A MapReduce-based system for querying and visualizing satellite data. In 2015 IEEE 31st International Conference on Data Engineering, ICDE 2015 (Vol. 2015-May, pp. 1444-1447). [7113397] IEEE Computer Society. https://doi.org/10.1109/ICDE.2015.7113397

A demonstration of Shahed : A MapReduce-based system for querying and visualizing satellite data. / Eldawy, Ahmed; Alharthi, Saif; Alzaidy, Abdulhadi; Daghistani, Anas; Ghani, Sohaib; Basalamah, Saleh; Mokbel, Mohamed.

2015 IEEE 31st International Conference on Data Engineering, ICDE 2015. Vol. 2015-May IEEE Computer Society, 2015. p. 1444-1447 7113397.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Eldawy, A, Alharthi, S, Alzaidy, A, Daghistani, A, Ghani, S, Basalamah, S & Mokbel, M 2015, A demonstration of Shahed: A MapReduce-based system for querying and visualizing satellite data. in 2015 IEEE 31st International Conference on Data Engineering, ICDE 2015. vol. 2015-May, 7113397, IEEE Computer Society, pp. 1444-1447, 2015 31st IEEE International Conference on Data Engineering, ICDE 2015, Seoul, Korea, Republic of, 13/4/15. https://doi.org/10.1109/ICDE.2015.7113397
Eldawy A, Alharthi S, Alzaidy A, Daghistani A, Ghani S, Basalamah S et al. A demonstration of Shahed: A MapReduce-based system for querying and visualizing satellite data. In 2015 IEEE 31st International Conference on Data Engineering, ICDE 2015. Vol. 2015-May. IEEE Computer Society. 2015. p. 1444-1447. 7113397 https://doi.org/10.1109/ICDE.2015.7113397
Eldawy, Ahmed ; Alharthi, Saif ; Alzaidy, Abdulhadi ; Daghistani, Anas ; Ghani, Sohaib ; Basalamah, Saleh ; Mokbel, Mohamed. / A demonstration of Shahed : A MapReduce-based system for querying and visualizing satellite data. 2015 IEEE 31st International Conference on Data Engineering, ICDE 2015. Vol. 2015-May IEEE Computer Society, 2015. pp. 1444-1447
@inproceedings{2bd2bb6eded04658813044c1112931a8,
title = "A demonstration of Shahed: A MapReduce-based system for querying and visualizing satellite data",
abstract = "Several space agencies such as NASA are continuously collecting datasets of earth dynamics - e.g., temperature, vegetation, and cloud coverage - through satellites. This data is stored in a publicly available archive for scientists and researchers and is very useful for studying climate, desertification, and land use change. The benefit of this data comes from its richness as it provides an archived history for over 15 years of satellite observations. Unfortunately, the use of such data is very limited due to the huge size of archives (> 500TB) and the limited capabilities of traditional applications. In this demo, we present Shahed, an interactive system which provides an efficient way to index, query, and visualize satellite datasets available in NASA archive. Shahed is composed of four main modules. The uncertainty module resolves data uncertainty imposed by the satellites. The indexing module organizes the data in a novel multi-resolution spatio-temporal index designed for satellite data. The querying module uses the indexes to answer both spatiotemporal selection and aggregate queries provided by the user. The visualization module generates images, videos, and multi-level images which gives an insight of data distribution and dynamics over time. This demo gives users a hands-on experience with Shahed through a map-based web interface in which users can browse the available datasets using the map, issue spatiotemporal queries, and visualize the results as images or videos.",
author = "Ahmed Eldawy and Saif Alharthi and Abdulhadi Alzaidy and Anas Daghistani and Sohaib Ghani and Saleh Basalamah and Mohamed Mokbel",
year = "2015",
month = "1",
day = "1",
doi = "10.1109/ICDE.2015.7113397",
language = "English",
volume = "2015-May",
pages = "1444--1447",
booktitle = "2015 IEEE 31st International Conference on Data Engineering, ICDE 2015",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - A demonstration of Shahed

T2 - A MapReduce-based system for querying and visualizing satellite data

AU - Eldawy, Ahmed

AU - Alharthi, Saif

AU - Alzaidy, Abdulhadi

AU - Daghistani, Anas

AU - Ghani, Sohaib

AU - Basalamah, Saleh

AU - Mokbel, Mohamed

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Several space agencies such as NASA are continuously collecting datasets of earth dynamics - e.g., temperature, vegetation, and cloud coverage - through satellites. This data is stored in a publicly available archive for scientists and researchers and is very useful for studying climate, desertification, and land use change. The benefit of this data comes from its richness as it provides an archived history for over 15 years of satellite observations. Unfortunately, the use of such data is very limited due to the huge size of archives (> 500TB) and the limited capabilities of traditional applications. In this demo, we present Shahed, an interactive system which provides an efficient way to index, query, and visualize satellite datasets available in NASA archive. Shahed is composed of four main modules. The uncertainty module resolves data uncertainty imposed by the satellites. The indexing module organizes the data in a novel multi-resolution spatio-temporal index designed for satellite data. The querying module uses the indexes to answer both spatiotemporal selection and aggregate queries provided by the user. The visualization module generates images, videos, and multi-level images which gives an insight of data distribution and dynamics over time. This demo gives users a hands-on experience with Shahed through a map-based web interface in which users can browse the available datasets using the map, issue spatiotemporal queries, and visualize the results as images or videos.

AB - Several space agencies such as NASA are continuously collecting datasets of earth dynamics - e.g., temperature, vegetation, and cloud coverage - through satellites. This data is stored in a publicly available archive for scientists and researchers and is very useful for studying climate, desertification, and land use change. The benefit of this data comes from its richness as it provides an archived history for over 15 years of satellite observations. Unfortunately, the use of such data is very limited due to the huge size of archives (> 500TB) and the limited capabilities of traditional applications. In this demo, we present Shahed, an interactive system which provides an efficient way to index, query, and visualize satellite datasets available in NASA archive. Shahed is composed of four main modules. The uncertainty module resolves data uncertainty imposed by the satellites. The indexing module organizes the data in a novel multi-resolution spatio-temporal index designed for satellite data. The querying module uses the indexes to answer both spatiotemporal selection and aggregate queries provided by the user. The visualization module generates images, videos, and multi-level images which gives an insight of data distribution and dynamics over time. This demo gives users a hands-on experience with Shahed through a map-based web interface in which users can browse the available datasets using the map, issue spatiotemporal queries, and visualize the results as images or videos.

UR - http://www.scopus.com/inward/record.url?scp=84940887250&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84940887250&partnerID=8YFLogxK

U2 - 10.1109/ICDE.2015.7113397

DO - 10.1109/ICDE.2015.7113397

M3 - Conference contribution

VL - 2015-May

SP - 1444

EP - 1447

BT - 2015 IEEE 31st International Conference on Data Engineering, ICDE 2015

PB - IEEE Computer Society

ER -