On-line multiscale filtering of random and gross errors without process models

Mohamed Nounou, Bhavik R. Bakshi

Research output: Contribution to journalReview article

98 Citations (Scopus)

Abstract

Data Rectification by univariate filtering is popular for processes lacking an accurate model. Linear filters are most popular for online filtering; however, they are single-scale best suited for rectifying data containing features and noise that are at the same resolution in time and frequency. Consequently, for multiscale data, linear filters are forced to trade off the extent of noise removal with the accuracy of the features retained. In contrast, nonlinear filtering methods, such as FMH and wavelet thresholding, are multiscale, but they cannot be used for online rectification. A technique is presented for online nonlinear filtering based on wavelet thresholding. OLMS rectification applies wavelet thresholding to data in a moving window of dyadic length to remove random errors. Gross errors are removed by combining wavelet thresholding with multiscale median filtering. Theoretical analysis shows that OLMS rectification using Haar wavelets subsumes mean filters of dyadic length, while rectification with smoother boundary corrected wavelets is analogous to adaptive exponential smoothing. If the rectified measurements are not needed online, the quality of rectification can be further improved by averaging the rectified signals in each window, overcoming the boundary effects encountered in TI rectification. Synthetic and industrial data show the benefits of the online multiscale and boundary corrected translation invariant rectification methods.

Original languageEnglish
Pages (from-to)1041-1058
Number of pages18
JournalAICHE Journal
Volume45
Issue number5
DOIs
Publication statusPublished - 1 Jan 1999
Externally publishedYes

    Fingerprint

ASJC Scopus subject areas

  • Biotechnology
  • Environmental Engineering
  • Chemical Engineering(all)

Cite this