Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Studies in Nonlinear Dynamics & Econometrics

Ed. by Mizrach, Bruce

5 Issues per year

IMPACT FACTOR 2017: 0.855

CiteScore 2017: 0.76

SCImago Journal Rank (SJR) 2017: 0.668
Source Normalized Impact per Paper (SNIP) 2017: 0.894

Mathematical Citation Quotient (MCQ) 2017: 0.02

See all formats and pricing
More options …
Volume 7, Issue 4


An Information Theoretic Approach for Estimating Nonlinear Dynamic Models

Amos Golan
Published Online: 2003-12-17 | DOI: https://doi.org/10.2202/1558-3708.1174

Given the objective of estimating the unknown parameters of a possibly nonlinear dynamic model using a finite (and relatively small) data set, it is common to use a Kalman filter Maximum Likelihood (ML) approach, ML-type estimators or more recently a GMM (Imbens, Spady and Johnson, 1998), BMOM (Zellner 1997), or other information theoretic estimators (e.g., Golan, Judge and Miller, 1996). Except for the BMOM, the above ML-type methods require some distributional assumptions while the moment-type estimators require some assumptions on the moments of the underlying distribution that generated the data. In the BMOM approach however, sampling assumptions underlying most ML and other approaches are not employed for the given data. The error terms are viewed as parameters with unknown values.Based on a generalization of the Maximum Entropy (ME), a semi-parametric, Information-Theoretic (IT) framework for estimating dynamic models with minimal distributional assumptions is formulated here. Like the BMOM approach, under this formulation, one views the errors as another set of unknown parameters to be estimated. Thus, for any data set, the estimation problem is ill-posed (under-determined) where the number of unknowns is always greater than the number of data points. The Information-Theoretic approach is one way to estimate the unknown parameters.After developing the basic IT (entropy) model, a computationally efficient concentrated model is developed where the optimization is done with respect to the Lagrange multipliers associated with each observation. The dual concentrated model is used to contrast this IT approach with the more traditional ML-type estimators. Statistics and inference procedures are developed as well. Monte Carlo results for estimating the parameters of noisy, chaotic systems are presented.

This article offers supplementary material which is provided at the end of the article.

About the article

Published Online: 2003-12-17

Citation Information: Studies in Nonlinear Dynamics & Econometrics, Volume 7, Issue 4, ISSN (Online) 1558-3708, DOI: https://doi.org/10.2202/1558-3708.1174.

Export Citation

©2011 Walter de Gruyter GmbH & Co. KG, Berlin/Boston.Get Permission

Supplementary Article Materials

Citing Articles

Here you can find all Crossref-listed publications in which this article is cited. If you would like to receive automatic email messages as soon as this article is cited in other publications, simply activate the “Citation Alert” on the top of this page.

Amos Golan and Henryk Gzyl
Entropy, 2010, Volume 12, Number 6, Page 1569

Comments (0)

Please log in or register to comment.
Log in