Taghreed: A system for querying, analyzing, and visualizing geotagged microblogs

Amr Magdy, Louai Alarabi, Saif Al-Harthi, Mashaal Musleh, Thanaa M. Ghanem, Sohaib Ghani, Mohamed Mokbel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

38 Citations (Scopus)

Abstract

This paper presents Taghreed; a full-fledged system for efficient and scalable querying, analyzing, and visualizing geo- tagged microblogs, e.g., tweets. Taghreed supports arbitrary queries on a large number (Billions) of microblogs that go up to several months in the past. Taghreed consists of four main components: (1) Indexer, (2) query engine, (3) recovery manager, and (4) visualizer. Taghreed indexer efficiently digests incoming microblogs with high arrival rates in light memory-resident indexes. When the memory be- comes full, a flushing policy manager transfers the mem- ory contents to disk indexes which are managing Billions of microblogs for several months. On memory failure, the recovery manager restores the system status from replicated copies for the main-memory content. Taghreed query engine consists of two modules: a query optimizer and a query processor. The query optimizer generates an optimal query plan to be executed by the query processor through efficient retrieval techniques to provide low query response, i.e., order of milliseconds. Taghreed visualizer allows end users to issue a wide variety of spatiotemporal queries. Then, it graphically presents the answers and allows interactive exploration through them. Taghreed is the first system that addresses all these challenges collectively for microblogs data. In the paper, each system component is described in detail.

Original languageEnglish
Title of host publication22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, ACM SIGSPATIAL GIS 2014
PublisherAssociation for Computing Machinery
Pages163-172
Number of pages10
Volume04-07-November-2014
ISBN (Electronic)9781450331319
DOIs
Publication statusPublished - 4 Nov 2014
Externally publishedYes
Event22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, ACM SIGSPATIAL GIS 2014 - Dallas, United States
Duration: 4 Nov 20147 Nov 2014

Other

Other22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, ACM SIGSPATIAL GIS 2014
CountryUnited States
CityDallas
Period4/11/147/11/14

    Fingerprint

Keywords

  • Indexing
  • Microblogs
  • Query Processing
  • Spatio-temporal

ASJC Scopus subject areas

  • Earth-Surface Processes
  • Computer Science Applications
  • Modelling and Simulation
  • Computer Graphics and Computer-Aided Design
  • Information Systems

Cite this

Magdy, A., Alarabi, L., Al-Harthi, S., Musleh, M., Ghanem, T. M., Ghani, S., & Mokbel, M. (2014). Taghreed: A system for querying, analyzing, and visualizing geotagged microblogs. In 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, ACM SIGSPATIAL GIS 2014 (Vol. 04-07-November-2014, pp. 163-172). Association for Computing Machinery. https://doi.org/10.1145/2666310.2666397