State and parameter estimation for nonlinear biological phenomena modeled by S-systems

Research output: Contribution to journalArticle

26 Citations (Scopus)

Abstract

Biological pathways can be modeled as a nonlinear system described by a set of nonlinear ordinary differential equations (ODEs). A central challenge in computational modeling of biological systems is the determination of the model parameters. In such cases, estimating these variables or parameters from other easily obtained measurements can be extremely useful. For example, time-series dynamic genomic data can be used to develop models representing dynamic genetic regulatory networks, which can be used to design intervention strategies to cure major diseases and to better understand the behavior of biological systems. Unfortunately, biological measurements are usually highly affected by errors that hide the important characteristics in the data. Therefore, these noisy measurements need to be filtered to enhance their usefulness in practice. This paper addresses the problem of state and parameter estimation of biological phenomena modeled by S-systems using Bayesian approaches, where the nonlinear observed system is assumed to progress according to a probabilistic state space model. The performances of various conventional and state-of-the-art state estimation techniques are compared. These techniques include the extended Kalman filter (EKF), unscented Kalman filter (UKF), particle filter (PF), and the developed improved particle filter (IPF). Specifically, two comparative studies are performed. In the first comparative study, the state variables (the enzyme CadA, the transport protein CadB, the regulatory protein CadC and lysine Lys for a model of the Cad System in E. coli (CSEC)) are estimated from noisy measurements of these variables, and the various estimation techniques are compared by computing the estimation root mean square error (RMSE) with respect to the noise-free data. In the second comparative study, the state variables as well as the model parameters are simultaneously estimated. In this case, in addition to comparing the performances of the various state estimation techniques, the effect of the number of estimated model parameters on the accuracy and convergence of these techniques is also assessed. The results of both comparative studies show that the UKF provides a higher accuracy than the EKF due to the limited ability of EKF to accurately estimate the mean and covariance matrix of the estimated states through lineralization of the nonlinear process model. The results also show that the IPF provides a significant improvement over PF because, unlike the PF which depends on the choice of sampling distribution used to estimate the posterior distribution, the IPF yields an optimum choice of the sampling distribution, which also accounts for the observed data. The results of the second comparative study show that, for all techniques, estimating more model parameters affects the estimation accuracy as well as the convergence of the estimated states and parameters. However, the IPF can still provide both convergence as well as accuracy related advantages over other estimation methods.

Original languageEnglish
Pages (from-to)1-17
Number of pages17
JournalDigital Signal Processing: A Review Journal
Volume28
Issue number1
DOIs
Publication statusPublished - 2014

Fingerprint

State estimation
Parameter estimation
Extended Kalman filters
Biological systems
Kalman filters
Nonlinear systems
Sampling
Covariance matrix
Ordinary differential equations
Mean square error
Escherichia coli
Time series
Dynamic models
Enzymes
Proteins

Keywords

  • Cad system in E. coli
  • Improved particle filtering
  • Nonlinear biological systems
  • State and parameter estimation

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering

Cite this

@article{78a91981b240496fb08b8ec058eb2487,
title = "State and parameter estimation for nonlinear biological phenomena modeled by S-systems",
abstract = "Biological pathways can be modeled as a nonlinear system described by a set of nonlinear ordinary differential equations (ODEs). A central challenge in computational modeling of biological systems is the determination of the model parameters. In such cases, estimating these variables or parameters from other easily obtained measurements can be extremely useful. For example, time-series dynamic genomic data can be used to develop models representing dynamic genetic regulatory networks, which can be used to design intervention strategies to cure major diseases and to better understand the behavior of biological systems. Unfortunately, biological measurements are usually highly affected by errors that hide the important characteristics in the data. Therefore, these noisy measurements need to be filtered to enhance their usefulness in practice. This paper addresses the problem of state and parameter estimation of biological phenomena modeled by S-systems using Bayesian approaches, where the nonlinear observed system is assumed to progress according to a probabilistic state space model. The performances of various conventional and state-of-the-art state estimation techniques are compared. These techniques include the extended Kalman filter (EKF), unscented Kalman filter (UKF), particle filter (PF), and the developed improved particle filter (IPF). Specifically, two comparative studies are performed. In the first comparative study, the state variables (the enzyme CadA, the transport protein CadB, the regulatory protein CadC and lysine Lys for a model of the Cad System in E. coli (CSEC)) are estimated from noisy measurements of these variables, and the various estimation techniques are compared by computing the estimation root mean square error (RMSE) with respect to the noise-free data. In the second comparative study, the state variables as well as the model parameters are simultaneously estimated. In this case, in addition to comparing the performances of the various state estimation techniques, the effect of the number of estimated model parameters on the accuracy and convergence of these techniques is also assessed. The results of both comparative studies show that the UKF provides a higher accuracy than the EKF due to the limited ability of EKF to accurately estimate the mean and covariance matrix of the estimated states through lineralization of the nonlinear process model. The results also show that the IPF provides a significant improvement over PF because, unlike the PF which depends on the choice of sampling distribution used to estimate the posterior distribution, the IPF yields an optimum choice of the sampling distribution, which also accounts for the observed data. The results of the second comparative study show that, for all techniques, estimating more model parameters affects the estimation accuracy as well as the convergence of the estimated states and parameters. However, the IPF can still provide both convergence as well as accuracy related advantages over other estimation methods.",
keywords = "Cad system in E. coli, Improved particle filtering, Nonlinear biological systems, State and parameter estimation",
author = "Majdi Mansouri and Hazem Nounou and Mohamed Nounou and Datta, {Aniruddha A.}",
year = "2014",
doi = "10.1016/j.dsp.2014.01.012",
language = "English",
volume = "28",
pages = "1--17",
journal = "Digital Signal Processing: A Review Journal",
issn = "1051-2004",
publisher = "Elsevier Inc.",
number = "1",

}

TY - JOUR

T1 - State and parameter estimation for nonlinear biological phenomena modeled by S-systems

AU - Mansouri, Majdi

AU - Nounou, Hazem

AU - Nounou, Mohamed

AU - Datta, Aniruddha A.

PY - 2014

Y1 - 2014

N2 - Biological pathways can be modeled as a nonlinear system described by a set of nonlinear ordinary differential equations (ODEs). A central challenge in computational modeling of biological systems is the determination of the model parameters. In such cases, estimating these variables or parameters from other easily obtained measurements can be extremely useful. For example, time-series dynamic genomic data can be used to develop models representing dynamic genetic regulatory networks, which can be used to design intervention strategies to cure major diseases and to better understand the behavior of biological systems. Unfortunately, biological measurements are usually highly affected by errors that hide the important characteristics in the data. Therefore, these noisy measurements need to be filtered to enhance their usefulness in practice. This paper addresses the problem of state and parameter estimation of biological phenomena modeled by S-systems using Bayesian approaches, where the nonlinear observed system is assumed to progress according to a probabilistic state space model. The performances of various conventional and state-of-the-art state estimation techniques are compared. These techniques include the extended Kalman filter (EKF), unscented Kalman filter (UKF), particle filter (PF), and the developed improved particle filter (IPF). Specifically, two comparative studies are performed. In the first comparative study, the state variables (the enzyme CadA, the transport protein CadB, the regulatory protein CadC and lysine Lys for a model of the Cad System in E. coli (CSEC)) are estimated from noisy measurements of these variables, and the various estimation techniques are compared by computing the estimation root mean square error (RMSE) with respect to the noise-free data. In the second comparative study, the state variables as well as the model parameters are simultaneously estimated. In this case, in addition to comparing the performances of the various state estimation techniques, the effect of the number of estimated model parameters on the accuracy and convergence of these techniques is also assessed. The results of both comparative studies show that the UKF provides a higher accuracy than the EKF due to the limited ability of EKF to accurately estimate the mean and covariance matrix of the estimated states through lineralization of the nonlinear process model. The results also show that the IPF provides a significant improvement over PF because, unlike the PF which depends on the choice of sampling distribution used to estimate the posterior distribution, the IPF yields an optimum choice of the sampling distribution, which also accounts for the observed data. The results of the second comparative study show that, for all techniques, estimating more model parameters affects the estimation accuracy as well as the convergence of the estimated states and parameters. However, the IPF can still provide both convergence as well as accuracy related advantages over other estimation methods.

AB - Biological pathways can be modeled as a nonlinear system described by a set of nonlinear ordinary differential equations (ODEs). A central challenge in computational modeling of biological systems is the determination of the model parameters. In such cases, estimating these variables or parameters from other easily obtained measurements can be extremely useful. For example, time-series dynamic genomic data can be used to develop models representing dynamic genetic regulatory networks, which can be used to design intervention strategies to cure major diseases and to better understand the behavior of biological systems. Unfortunately, biological measurements are usually highly affected by errors that hide the important characteristics in the data. Therefore, these noisy measurements need to be filtered to enhance their usefulness in practice. This paper addresses the problem of state and parameter estimation of biological phenomena modeled by S-systems using Bayesian approaches, where the nonlinear observed system is assumed to progress according to a probabilistic state space model. The performances of various conventional and state-of-the-art state estimation techniques are compared. These techniques include the extended Kalman filter (EKF), unscented Kalman filter (UKF), particle filter (PF), and the developed improved particle filter (IPF). Specifically, two comparative studies are performed. In the first comparative study, the state variables (the enzyme CadA, the transport protein CadB, the regulatory protein CadC and lysine Lys for a model of the Cad System in E. coli (CSEC)) are estimated from noisy measurements of these variables, and the various estimation techniques are compared by computing the estimation root mean square error (RMSE) with respect to the noise-free data. In the second comparative study, the state variables as well as the model parameters are simultaneously estimated. In this case, in addition to comparing the performances of the various state estimation techniques, the effect of the number of estimated model parameters on the accuracy and convergence of these techniques is also assessed. The results of both comparative studies show that the UKF provides a higher accuracy than the EKF due to the limited ability of EKF to accurately estimate the mean and covariance matrix of the estimated states through lineralization of the nonlinear process model. The results also show that the IPF provides a significant improvement over PF because, unlike the PF which depends on the choice of sampling distribution used to estimate the posterior distribution, the IPF yields an optimum choice of the sampling distribution, which also accounts for the observed data. The results of the second comparative study show that, for all techniques, estimating more model parameters affects the estimation accuracy as well as the convergence of the estimated states and parameters. However, the IPF can still provide both convergence as well as accuracy related advantages over other estimation methods.

KW - Cad system in E. coli

KW - Improved particle filtering

KW - Nonlinear biological systems

KW - State and parameter estimation

UR - http://www.scopus.com/inward/record.url?scp=84895439479&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84895439479&partnerID=8YFLogxK

U2 - 10.1016/j.dsp.2014.01.012

DO - 10.1016/j.dsp.2014.01.012

M3 - Article

VL - 28

SP - 1

EP - 17

JO - Digital Signal Processing: A Review Journal

JF - Digital Signal Processing: A Review Journal

SN - 1051-2004

IS - 1

ER -