KDE-Track: An Efficient Dynamic Density Estimator for Data Streams

Abdulhakim Qahtan, Suojin Wang, Xiangliang Zhang

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Recent developments in sensors, global positioning system devices, and smart phones have increased the availability of spatiotemporal data streams. Developing models for mining such streams is challenged by the huge amount of data that cannot be stored in the memory, the high arrival speed, and the dynamic changes in the data distribution. Density estimation is an important technique in stream mining for a wide variety of applications. The construction of kernel density estimators is well studied and documented. However, existing techniques are either expensive or inaccurate and unable to capture the changes in the data distribution. In this paper, we present a method called KDE-Track to estimate the density of spatiotemporal data streams. KDE-Track can efficiently estimate the density function with linear time complexity using interpolation on a kernel model, which is incrementally updated upon the arrival of new samples from the stream. We also propose an accurate and efficient method for selecting the bandwidth value for the kernel density estimator, which increases its accuracy significantly. Both theoretical analysis and experimental validation show that KDE-Track outperforms a set of baseline methods on the estimation accuracy and computing time of complex density structures in data streams.

Original languageEnglish
Article number7738463
Pages (from-to)642-655
Number of pages14
JournalIEEE Transactions on Knowledge and Data Engineering
Volume29
Issue number3
DOIs
Publication statusPublished - 1 Mar 2017
Externally publishedYes

    Fingerprint

Keywords

  • Adaptive resampling
  • Bandwidth selection
  • Data streams
  • Dynamic density estimation
  • Interpolation

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Computational Theory and Mathematics

Cite this