Fast data stream algorithms using associative memories

Nagender Bandi, Ahmed Metwally, Divyakant Agrawal, Amr El Abbadi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

31 Citations (Scopus)

Abstract

The primary goal of data stream research is to develop space and time efficient solutions for answering continuous on-line summarization queries. Research efforts over the last decade have resulted in a number of efficient algorithms with varying degrees of space and time complexities. While these techniques are developed in a standard CPU setting, many of their applications such as click-fraud detection and network-traffic summarization typically execute on special networking architectures called Network Processing Units (NPUs). These NPUs interface with special associative memories known as Ternary Content Addressable Memories (TCAMs) to provide gigabit rate forwarding at network routers. In this paper, we describe how the integrated architecture of NPU and TCAMs can be exploited towards achieving the goal of developing high-speed stream summarization solutions. We propose two TCAM-conscious solutions for the frequent elements problem in data streams and present a comprehensive evaluation of these techniques on a state-of-the-art networking platform.

Original languageEnglish
Title of host publicationSIGMOD 2007
Subtitle of host publicationProceedings of the ACM SIGMOD International Conference on Management of Data
Pages247-256
Number of pages10
DOIs
Publication statusPublished - 30 Oct 2007
EventSIGMOD 2007: ACM SIGMOD International Conference on Management of Data - Beijing, China
Duration: 12 Jun 200714 Jun 2007

Publication series

NameProceedings of the ACM SIGMOD International Conference on Management of Data
ISSN (Print)0730-8078

Other

OtherSIGMOD 2007: ACM SIGMOD International Conference on Management of Data
CountryChina
CityBeijing
Period12/6/0714/6/07

    Fingerprint

Keywords

  • Data streams
  • Hardware
  • TCAMS

ASJC Scopus subject areas

  • Software
  • Information Systems

Cite this

Bandi, N., Metwally, A., Agrawal, D., & El Abbadi, A. (2007). Fast data stream algorithms using associative memories. In SIGMOD 2007: Proceedings of the ACM SIGMOD International Conference on Management of Data (pp. 247-256). (Proceedings of the ACM SIGMOD International Conference on Management of Data). https://doi.org/10.1145/1247480.1247510