We present a method for estimating Markov dynamic models with unobserved state variables which can be serially correlated over time. We focus on the case where all the model variables have discrete support. Our estimator is simple to compute because it is noniterative, and involves only elementary matrix manipulations. Our estimation method is nonparametric, in that no parametric assumptions on the distributions of the unobserved state variables or the laws of motions of the state variables are required. Monte Carlo simulations show that the estimator performs well in practice, and we illustrate its use with a dataset of doctors’ prescription of pharmaceutical drugs.
Abbring, J., and J. Heckman. 2007. “Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation.” In Handbook of Econometrics, Vol. 6B, edited by by J. Heckman and E. Leamer, chap. 72. Amsterdam: Elsevier.
Aguirregabiria, V., and P. Mira. 2002. “Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models.” Econometrica 70: 1519–1543.
Aguirregabiria, V., and P. Mira. 2002. “Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models.” Econometrica 70: 1519–1543.10.1111/1468-0262.00340)| false
Andrew, A., K.-W. Chu, and P. Lancaster. 1993. “Derivatives of Eigenvalues and Eigenvectors of Matrix Functions.” SIAM Journal on Matrix Analysis and Applications 14 (4): 903–926.10.1137/0614061)| false
Ghahramani, Z. 2001. “An Introduction to Hidden Markov Models and Bayesian Networks.” International Journal of Pattern Recognition and Artificial Intelligence 15: 9–42.10.1142/S0218001401000836)| false
Hu, Y. 2008. “Identification and Estimation of Nonlinear Models with Misclassification Error Using Instrumental Variables: A General Solution.” Journal of Econometrics 144: 27–61.10.1016/j.jeconom.2007.12.001)| false
Keane, M., and K. Wolpin. 1994. “The Solution and Estimation of Discrete Choice Dynamic Programming Models by Simulation and Interpolation: Monte Carlo Evidence.” Review of Economics and Statistics 76: 648–672.
Keane, M., and K. Wolpin. 1994. “The Solution and Estimation of Discrete Choice Dynamic Programming Models by Simulation and Interpolation: Monte Carlo Evidence.” Review of Economics and Statistics 76: 648–672.10.2307/2109768)| false
Pakes, A., M. Ostrovsky, and S. Berry. 2007. “Simple Estimators for the Parameters of Discrete Dynamic Games (with Entry Exit Examples).” RAND Journal of Economics 38: 373–399.10.1111/j.1756-2171.2007.tb00073.x)| false
The Journal of Econometric Methods aims to bridge the widening gap between econometric research and empirical practice. It publishes papers from top scholars in all areas of econometrics that consider a topic of broad interest to practitioners and are written in a style that is targeted at practitioners.