### Abstract

Multiscale representation of data has shown great shrinkage abilities when used in data filtering. This paper shows that multiscale representation has similar advantages when used in empirical process modeling. One advantage is that it helps separate noise from important features, which helps improve the accuracy of estimated models. Another advantage is the fact that the number of significant cross-correlation function (CCF) coefficients relating the scaled signal approximations of the input and output data shrinks in half (i.e., decreases dyadically) at every subsequent coarser scale. This advantage is very important in FIR modeling because it means that smaller FIR models are needed at coarse scales. This advantage is exploited to develop a Multiscale Finite Impulse Response (MSFIR) modeling algorithm that helps deal with the collinearity problem often encountered in FIR models. The idea is to decompose the input-output data at multiple scales, and using the scaled signals at each scale, construct smaller FIR models with less collinearity, and then select among all scales the optimum estimated model. The developed MSFIR modeling algorithm is finally shown to outperform some of the existing FIR model estimation methods, such as Ordinary Least Squares (OLS) regression, Ridge Regression (RR), and Principal Component Regression (PCR). A key reason for the advantage of MSFIR over RR is that MSFIR shrinks the statistically insignificant CCF coefficients and noise wavelet coefficients (which are statistically zero) towards zero, while RR shrinks the FIR coefficients towards zero, while they are not.

Original language | English |
---|---|

Pages (from-to) | 289-304 |

Number of pages | 16 |

Journal | Engineering Applications of Artificial Intelligence |

Volume | 19 |

Issue number | 3 |

DOIs | |

Publication status | Published - 1 Apr 2006 |

Externally published | Yes |

### Fingerprint

### Keywords

- Finite impulse response model
- Multiscale
- Regression

### ASJC Scopus subject areas

- Control and Systems Engineering
- Artificial Intelligence
- Electrical and Electronic Engineering

### Cite this

**Multiscale finite impulse response modeling.** / Nounou, Mohamed.

Research output: Contribution to journal › Article

*Engineering Applications of Artificial Intelligence*, vol. 19, no. 3, pp. 289-304. https://doi.org/10.1016/j.engappai.2005.09.007

}

TY - JOUR

T1 - Multiscale finite impulse response modeling

AU - Nounou, Mohamed

PY - 2006/4/1

Y1 - 2006/4/1

N2 - Multiscale representation of data has shown great shrinkage abilities when used in data filtering. This paper shows that multiscale representation has similar advantages when used in empirical process modeling. One advantage is that it helps separate noise from important features, which helps improve the accuracy of estimated models. Another advantage is the fact that the number of significant cross-correlation function (CCF) coefficients relating the scaled signal approximations of the input and output data shrinks in half (i.e., decreases dyadically) at every subsequent coarser scale. This advantage is very important in FIR modeling because it means that smaller FIR models are needed at coarse scales. This advantage is exploited to develop a Multiscale Finite Impulse Response (MSFIR) modeling algorithm that helps deal with the collinearity problem often encountered in FIR models. The idea is to decompose the input-output data at multiple scales, and using the scaled signals at each scale, construct smaller FIR models with less collinearity, and then select among all scales the optimum estimated model. The developed MSFIR modeling algorithm is finally shown to outperform some of the existing FIR model estimation methods, such as Ordinary Least Squares (OLS) regression, Ridge Regression (RR), and Principal Component Regression (PCR). A key reason for the advantage of MSFIR over RR is that MSFIR shrinks the statistically insignificant CCF coefficients and noise wavelet coefficients (which are statistically zero) towards zero, while RR shrinks the FIR coefficients towards zero, while they are not.

AB - Multiscale representation of data has shown great shrinkage abilities when used in data filtering. This paper shows that multiscale representation has similar advantages when used in empirical process modeling. One advantage is that it helps separate noise from important features, which helps improve the accuracy of estimated models. Another advantage is the fact that the number of significant cross-correlation function (CCF) coefficients relating the scaled signal approximations of the input and output data shrinks in half (i.e., decreases dyadically) at every subsequent coarser scale. This advantage is very important in FIR modeling because it means that smaller FIR models are needed at coarse scales. This advantage is exploited to develop a Multiscale Finite Impulse Response (MSFIR) modeling algorithm that helps deal with the collinearity problem often encountered in FIR models. The idea is to decompose the input-output data at multiple scales, and using the scaled signals at each scale, construct smaller FIR models with less collinearity, and then select among all scales the optimum estimated model. The developed MSFIR modeling algorithm is finally shown to outperform some of the existing FIR model estimation methods, such as Ordinary Least Squares (OLS) regression, Ridge Regression (RR), and Principal Component Regression (PCR). A key reason for the advantage of MSFIR over RR is that MSFIR shrinks the statistically insignificant CCF coefficients and noise wavelet coefficients (which are statistically zero) towards zero, while RR shrinks the FIR coefficients towards zero, while they are not.

KW - Finite impulse response model

KW - Multiscale

KW - Regression

UR - http://www.scopus.com/inward/record.url?scp=31744434940&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=31744434940&partnerID=8YFLogxK

U2 - 10.1016/j.engappai.2005.09.007

DO - 10.1016/j.engappai.2005.09.007

M3 - Article

VL - 19

SP - 289

EP - 304

JO - Engineering Applications of Artificial Intelligence

JF - Engineering Applications of Artificial Intelligence

SN - 0952-1976

IS - 3

ER -