Process monitoring using PCA-based GLR methods

A comparative study

M. Ziyan Sheriff, M. Nazmul Karim, Hazem Nounou, Mohamed Nounou

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Statistical process monitoring is a key requirement for many industrial processes. Many of these processes utilize Principal Component Analysis (PCA) in order to carry out statistical process monitoring due to its computational simplicity. Two fault detection charts that are commonly used with the PCA method are the Hotelling T2 and Q statistics. Although these charts are reasonably able to detect most shifts in the process mean, they may be unable to accurately detect other process faults, such as shifts in the process variance. Hypothesis testing methods such as the Generalized Likelihood Ratio (GLR) chart have been developed in order to detect different types of deviations from normal operating conditions, i.e., process faults. Although, GLR charts have shown superior performance in terms of fault detection compared to other existing techniques, literature has only examined the performance of a PCA-based GLR chart designed to detect shifts in the mean. Through a simulated synthetic example, this work evaluates the performance of PCA-based GLR charts designed to independently detect a shift in the mean, independently detect a shift in the variance, and simultaneously detect shifts in the mean and/or variance. The results show that in order to detect a shift in the mean or a shift in the variance, the GLR charts designed to independently detect either type of fault need to be implemented in parallel as they provide significantly lower missed detection rates, than a GLR chart designed to detect shifts in both the process mean and variance simultaneously. The GLR chart designed to simultaneously detect both a shift in the mean and variance does not perform as well as the other GLR charts, since two parameters (both the mean and variance) need to be estimated for this method while maximizing the GLR statistic, as opposed to just a single parameter for the other GLR charts. The practical applicability of the PCA-based GLR charts is demonstrated through the well-known benchmark Tennessee Eastman process, and through a case where autocorrelation is present in the data. Therefore, in order to detect shifts in the mean and/or variance, we recommend parallel implementation of the GLR charts designed to independently detect shifts in the mean, and independently detect shifts in the variance Parallel implementation of these two GLR charts aids with fault classification as well. This work also discusses the importance of selecting an appropriate window length of previous data to be used when computing the maximum likelihood estimates (MLEs) and maximizing the GLR statistic, keeping all fault detection criteria in mind in order to ensure that the desired fault detection results are obtained.

Original languageEnglish
Pages (from-to)227-246
Number of pages20
JournalJournal of Computational Science
Volume27
DOIs
Publication statusPublished - 1 Jul 2018

Fingerprint

Process Monitoring
Process monitoring
Likelihood Ratio
Chart
Principal component analysis
Principal Component Analysis
Comparative Study
Fault detection
Statistics
Fault Detection
Fault
Autocorrelation
Maximum likelihood
Process Mean
Likelihood Ratio Statistic
Parallel Implementation
Testing
Hotelling's T2
Hypothesis Testing
Maximum Likelihood Estimate

Keywords

  • Fault detection
  • Generalized likelihood ratio
  • Hypothesis testing
  • Principal component analysis
  • Statistical process monitoring
  • Tennessee Eastman process

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)
  • Modelling and Simulation

Cite this

Process monitoring using PCA-based GLR methods : A comparative study. / Sheriff, M. Ziyan; Karim, M. Nazmul; Nounou, Hazem; Nounou, Mohamed.

In: Journal of Computational Science, Vol. 27, 01.07.2018, p. 227-246.

Research output: Contribution to journalArticle

@article{ae501de7406a4291bff160194130c34b,
title = "Process monitoring using PCA-based GLR methods: A comparative study",
abstract = "Statistical process monitoring is a key requirement for many industrial processes. Many of these processes utilize Principal Component Analysis (PCA) in order to carry out statistical process monitoring due to its computational simplicity. Two fault detection charts that are commonly used with the PCA method are the Hotelling T2 and Q statistics. Although these charts are reasonably able to detect most shifts in the process mean, they may be unable to accurately detect other process faults, such as shifts in the process variance. Hypothesis testing methods such as the Generalized Likelihood Ratio (GLR) chart have been developed in order to detect different types of deviations from normal operating conditions, i.e., process faults. Although, GLR charts have shown superior performance in terms of fault detection compared to other existing techniques, literature has only examined the performance of a PCA-based GLR chart designed to detect shifts in the mean. Through a simulated synthetic example, this work evaluates the performance of PCA-based GLR charts designed to independently detect a shift in the mean, independently detect a shift in the variance, and simultaneously detect shifts in the mean and/or variance. The results show that in order to detect a shift in the mean or a shift in the variance, the GLR charts designed to independently detect either type of fault need to be implemented in parallel as they provide significantly lower missed detection rates, than a GLR chart designed to detect shifts in both the process mean and variance simultaneously. The GLR chart designed to simultaneously detect both a shift in the mean and variance does not perform as well as the other GLR charts, since two parameters (both the mean and variance) need to be estimated for this method while maximizing the GLR statistic, as opposed to just a single parameter for the other GLR charts. The practical applicability of the PCA-based GLR charts is demonstrated through the well-known benchmark Tennessee Eastman process, and through a case where autocorrelation is present in the data. Therefore, in order to detect shifts in the mean and/or variance, we recommend parallel implementation of the GLR charts designed to independently detect shifts in the mean, and independently detect shifts in the variance Parallel implementation of these two GLR charts aids with fault classification as well. This work also discusses the importance of selecting an appropriate window length of previous data to be used when computing the maximum likelihood estimates (MLEs) and maximizing the GLR statistic, keeping all fault detection criteria in mind in order to ensure that the desired fault detection results are obtained.",
keywords = "Fault detection, Generalized likelihood ratio, Hypothesis testing, Principal component analysis, Statistical process monitoring, Tennessee Eastman process",
author = "Sheriff, {M. Ziyan} and Karim, {M. Nazmul} and Hazem Nounou and Mohamed Nounou",
year = "2018",
month = "7",
day = "1",
doi = "10.1016/j.jocs.2018.05.013",
language = "English",
volume = "27",
pages = "227--246",
journal = "Journal of Computational Science",
issn = "1877-7503",
publisher = "Elsevier",

}

TY - JOUR

T1 - Process monitoring using PCA-based GLR methods

T2 - A comparative study

AU - Sheriff, M. Ziyan

AU - Karim, M. Nazmul

AU - Nounou, Hazem

AU - Nounou, Mohamed

PY - 2018/7/1

Y1 - 2018/7/1

N2 - Statistical process monitoring is a key requirement for many industrial processes. Many of these processes utilize Principal Component Analysis (PCA) in order to carry out statistical process monitoring due to its computational simplicity. Two fault detection charts that are commonly used with the PCA method are the Hotelling T2 and Q statistics. Although these charts are reasonably able to detect most shifts in the process mean, they may be unable to accurately detect other process faults, such as shifts in the process variance. Hypothesis testing methods such as the Generalized Likelihood Ratio (GLR) chart have been developed in order to detect different types of deviations from normal operating conditions, i.e., process faults. Although, GLR charts have shown superior performance in terms of fault detection compared to other existing techniques, literature has only examined the performance of a PCA-based GLR chart designed to detect shifts in the mean. Through a simulated synthetic example, this work evaluates the performance of PCA-based GLR charts designed to independently detect a shift in the mean, independently detect a shift in the variance, and simultaneously detect shifts in the mean and/or variance. The results show that in order to detect a shift in the mean or a shift in the variance, the GLR charts designed to independently detect either type of fault need to be implemented in parallel as they provide significantly lower missed detection rates, than a GLR chart designed to detect shifts in both the process mean and variance simultaneously. The GLR chart designed to simultaneously detect both a shift in the mean and variance does not perform as well as the other GLR charts, since two parameters (both the mean and variance) need to be estimated for this method while maximizing the GLR statistic, as opposed to just a single parameter for the other GLR charts. The practical applicability of the PCA-based GLR charts is demonstrated through the well-known benchmark Tennessee Eastman process, and through a case where autocorrelation is present in the data. Therefore, in order to detect shifts in the mean and/or variance, we recommend parallel implementation of the GLR charts designed to independently detect shifts in the mean, and independently detect shifts in the variance Parallel implementation of these two GLR charts aids with fault classification as well. This work also discusses the importance of selecting an appropriate window length of previous data to be used when computing the maximum likelihood estimates (MLEs) and maximizing the GLR statistic, keeping all fault detection criteria in mind in order to ensure that the desired fault detection results are obtained.

AB - Statistical process monitoring is a key requirement for many industrial processes. Many of these processes utilize Principal Component Analysis (PCA) in order to carry out statistical process monitoring due to its computational simplicity. Two fault detection charts that are commonly used with the PCA method are the Hotelling T2 and Q statistics. Although these charts are reasonably able to detect most shifts in the process mean, they may be unable to accurately detect other process faults, such as shifts in the process variance. Hypothesis testing methods such as the Generalized Likelihood Ratio (GLR) chart have been developed in order to detect different types of deviations from normal operating conditions, i.e., process faults. Although, GLR charts have shown superior performance in terms of fault detection compared to other existing techniques, literature has only examined the performance of a PCA-based GLR chart designed to detect shifts in the mean. Through a simulated synthetic example, this work evaluates the performance of PCA-based GLR charts designed to independently detect a shift in the mean, independently detect a shift in the variance, and simultaneously detect shifts in the mean and/or variance. The results show that in order to detect a shift in the mean or a shift in the variance, the GLR charts designed to independently detect either type of fault need to be implemented in parallel as they provide significantly lower missed detection rates, than a GLR chart designed to detect shifts in both the process mean and variance simultaneously. The GLR chart designed to simultaneously detect both a shift in the mean and variance does not perform as well as the other GLR charts, since two parameters (both the mean and variance) need to be estimated for this method while maximizing the GLR statistic, as opposed to just a single parameter for the other GLR charts. The practical applicability of the PCA-based GLR charts is demonstrated through the well-known benchmark Tennessee Eastman process, and through a case where autocorrelation is present in the data. Therefore, in order to detect shifts in the mean and/or variance, we recommend parallel implementation of the GLR charts designed to independently detect shifts in the mean, and independently detect shifts in the variance Parallel implementation of these two GLR charts aids with fault classification as well. This work also discusses the importance of selecting an appropriate window length of previous data to be used when computing the maximum likelihood estimates (MLEs) and maximizing the GLR statistic, keeping all fault detection criteria in mind in order to ensure that the desired fault detection results are obtained.

KW - Fault detection

KW - Generalized likelihood ratio

KW - Hypothesis testing

KW - Principal component analysis

KW - Statistical process monitoring

KW - Tennessee Eastman process

UR - http://www.scopus.com/inward/record.url?scp=85049738723&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049738723&partnerID=8YFLogxK

U2 - 10.1016/j.jocs.2018.05.013

DO - 10.1016/j.jocs.2018.05.013

M3 - Article

VL - 27

SP - 227

EP - 246

JO - Journal of Computational Science

JF - Journal of Computational Science

SN - 1877-7503

ER -