CAM conscious integrated answering of frequent elements and top-k queries over data streams

Sudipto Das, Divyakant Agrawal, Amr El Abbadi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

Frequent elements and top-k queries constitute an important class of queries for data stream analysis applications. Certain applications require answers for both frequent elements and top-k queries on the same stream. In addition, the ever increasing data rates call for providing fast answers to the queries, and researchers have been looking towards exploiting specialized hardware for this purpose. Content Addressable Memory(CAM) provides an efficient way of looking up elements and hence are well suited for the class of algorithms that involve lookups. In this paper, we present a fast and efficient CAM conscious integrated solution for answering both frequent elements and top-k queries on the same stream. We call our scheme CAM conscious Space Saving with Stream Summary (CSSwSS), and it can efficiently answer continuous queries. We provide an implementation of the proposed scheme using commodity CAM chips, and the experimental evaluation demonstrates that not only does the proposed scheme outperforms existing CAM conscious techniques by an order of magnitude at query loads of about 10%, but the proposed scheme can also efficiently answer continuous queries.

Original languageEnglish
Title of host publicationProceedings of the 4th International Workshop on Data Management on New Hardware, DaMoN'08 - In conjuction with ACM SIGMOD/PODS Conference
Pages1-10
Number of pages10
DOIs
Publication statusPublished - 1 Dec 2008
Externally publishedYes
Event4th International Workshop on Data Management on New Hardware, DaMoN'08 - Vancouver, BC, Canada
Duration: 13 Jun 200813 Jun 2008

Other

Other4th International Workshop on Data Management on New Hardware, DaMoN'08
CountryCanada
CityVancouver, BC
Period13/6/0813/6/08

Fingerprint

Associative storage
Hardware

Keywords

  • Content addressable memory
  • Data streams
  • Frequent elements queries
  • Network processor
  • Top-k queries

ASJC Scopus subject areas

  • Computer Science Applications
  • Hardware and Architecture
  • Software

Cite this

Das, S., Agrawal, D., & Abbadi, A. E. (2008). CAM conscious integrated answering of frequent elements and top-k queries over data streams. In Proceedings of the 4th International Workshop on Data Management on New Hardware, DaMoN'08 - In conjuction with ACM SIGMOD/PODS Conference (pp. 1-10) https://doi.org/10.1145/1457150.1457152

CAM conscious integrated answering of frequent elements and top-k queries over data streams. / Das, Sudipto; Agrawal, Divyakant; Abbadi, Amr El.

Proceedings of the 4th International Workshop on Data Management on New Hardware, DaMoN'08 - In conjuction with ACM SIGMOD/PODS Conference. 2008. p. 1-10.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Das, S, Agrawal, D & Abbadi, AE 2008, CAM conscious integrated answering of frequent elements and top-k queries over data streams. in Proceedings of the 4th International Workshop on Data Management on New Hardware, DaMoN'08 - In conjuction with ACM SIGMOD/PODS Conference. pp. 1-10, 4th International Workshop on Data Management on New Hardware, DaMoN'08, Vancouver, BC, Canada, 13/6/08. https://doi.org/10.1145/1457150.1457152
Das S, Agrawal D, Abbadi AE. CAM conscious integrated answering of frequent elements and top-k queries over data streams. In Proceedings of the 4th International Workshop on Data Management on New Hardware, DaMoN'08 - In conjuction with ACM SIGMOD/PODS Conference. 2008. p. 1-10 https://doi.org/10.1145/1457150.1457152
Das, Sudipto ; Agrawal, Divyakant ; Abbadi, Amr El. / CAM conscious integrated answering of frequent elements and top-k queries over data streams. Proceedings of the 4th International Workshop on Data Management on New Hardware, DaMoN'08 - In conjuction with ACM SIGMOD/PODS Conference. 2008. pp. 1-10
@inproceedings{bf68b57c2400470cbe2ba11a3ee650b5,
title = "CAM conscious integrated answering of frequent elements and top-k queries over data streams",
abstract = "Frequent elements and top-k queries constitute an important class of queries for data stream analysis applications. Certain applications require answers for both frequent elements and top-k queries on the same stream. In addition, the ever increasing data rates call for providing fast answers to the queries, and researchers have been looking towards exploiting specialized hardware for this purpose. Content Addressable Memory(CAM) provides an efficient way of looking up elements and hence are well suited for the class of algorithms that involve lookups. In this paper, we present a fast and efficient CAM conscious integrated solution for answering both frequent elements and top-k queries on the same stream. We call our scheme CAM conscious Space Saving with Stream Summary (CSSwSS), and it can efficiently answer continuous queries. We provide an implementation of the proposed scheme using commodity CAM chips, and the experimental evaluation demonstrates that not only does the proposed scheme outperforms existing CAM conscious techniques by an order of magnitude at query loads of about 10{\%}, but the proposed scheme can also efficiently answer continuous queries.",
keywords = "Content addressable memory, Data streams, Frequent elements queries, Network processor, Top-k queries",
author = "Sudipto Das and Divyakant Agrawal and Abbadi, {Amr El}",
year = "2008",
month = "12",
day = "1",
doi = "10.1145/1457150.1457152",
language = "English",
isbn = "9781605581842",
pages = "1--10",
booktitle = "Proceedings of the 4th International Workshop on Data Management on New Hardware, DaMoN'08 - In conjuction with ACM SIGMOD/PODS Conference",

}

TY - GEN

T1 - CAM conscious integrated answering of frequent elements and top-k queries over data streams

AU - Das, Sudipto

AU - Agrawal, Divyakant

AU - Abbadi, Amr El

PY - 2008/12/1

Y1 - 2008/12/1

N2 - Frequent elements and top-k queries constitute an important class of queries for data stream analysis applications. Certain applications require answers for both frequent elements and top-k queries on the same stream. In addition, the ever increasing data rates call for providing fast answers to the queries, and researchers have been looking towards exploiting specialized hardware for this purpose. Content Addressable Memory(CAM) provides an efficient way of looking up elements and hence are well suited for the class of algorithms that involve lookups. In this paper, we present a fast and efficient CAM conscious integrated solution for answering both frequent elements and top-k queries on the same stream. We call our scheme CAM conscious Space Saving with Stream Summary (CSSwSS), and it can efficiently answer continuous queries. We provide an implementation of the proposed scheme using commodity CAM chips, and the experimental evaluation demonstrates that not only does the proposed scheme outperforms existing CAM conscious techniques by an order of magnitude at query loads of about 10%, but the proposed scheme can also efficiently answer continuous queries.

AB - Frequent elements and top-k queries constitute an important class of queries for data stream analysis applications. Certain applications require answers for both frequent elements and top-k queries on the same stream. In addition, the ever increasing data rates call for providing fast answers to the queries, and researchers have been looking towards exploiting specialized hardware for this purpose. Content Addressable Memory(CAM) provides an efficient way of looking up elements and hence are well suited for the class of algorithms that involve lookups. In this paper, we present a fast and efficient CAM conscious integrated solution for answering both frequent elements and top-k queries on the same stream. We call our scheme CAM conscious Space Saving with Stream Summary (CSSwSS), and it can efficiently answer continuous queries. We provide an implementation of the proposed scheme using commodity CAM chips, and the experimental evaluation demonstrates that not only does the proposed scheme outperforms existing CAM conscious techniques by an order of magnitude at query loads of about 10%, but the proposed scheme can also efficiently answer continuous queries.

KW - Content addressable memory

KW - Data streams

KW - Frequent elements queries

KW - Network processor

KW - Top-k queries

UR - http://www.scopus.com/inward/record.url?scp=67649653490&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67649653490&partnerID=8YFLogxK

U2 - 10.1145/1457150.1457152

DO - 10.1145/1457150.1457152

M3 - Conference contribution

SN - 9781605581842

SP - 1

EP - 10

BT - Proceedings of the 4th International Workshop on Data Management on New Hardware, DaMoN'08 - In conjuction with ACM SIGMOD/PODS Conference

ER -