Abstract
We develop a non-linear forecast combination rule based on copulas that incorporate the dynamic interaction between individual predictors. This approach is optimal in the sense that the resulting combined forecast produces the highest discriminatory power as measured by the receiver operating characteristic (ROC) curve. Under additional assumptions, this rule is shown to be equivalent to the quintessential linear combination scheme. To illustrate its usefulness, we apply this methodology to optimally aggregate two currently used leading indicators – the ISM new order diffusion index and the yield curve spread – to predict economic recessions in the United States. We also examine the sources of forecasting gains using a counterfactual experimental set up.
Acknowledgments
The authors are grateful to James Ramsey and other participants at the 22nd SNDE Symposium in New York city, to Joerg Breitung, Frank Diebold, Hans Manner, Ataman Ozyildirim, Philip Rothman, Pravin Trivedi, David Zimmer, and an anonymous referee for making valuable comments and suggestions. However, we solely are responsible for any errors and omissions.
References
Albert, J. 2009. Bayesian Computation with R. New York: Springer.10.1007/978-0-387-92298-0Search in Google Scholar
Anatolyev, S. 2009. “Multi-Market Direction-of-Change Modeling Using Dependence Ratios.” Studies in Nonlinear Dynamics & Econometrics 13: Article 5.10.2202/1558-3708.1532Search in Google Scholar
Andrews, D. W. K. 1991. “Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation.” Econometrica 59: 817–858.10.2307/2938229Search in Google Scholar
Andrews, D. W. K., and J. C. Monahan. 1992. “An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator.” Econometrica 60: 953–966.10.2307/2951574Search in Google Scholar
Bates, J. M., and C. W. J. Granger. 1969. “The Combination of Forecasts.” Operational Research Quarterly 20: 451–468.10.1017/CBO9780511753961.021Search in Google Scholar
Berge, T. J., and Ò. Jordà. 2011. “Evaluating the Classification of Economic Activity into Recessions and Expansions.” American Economic Journal: Macroeconomics 3: 246–277.10.1257/mac.3.2.246Search in Google Scholar
Berk, R. H. 1966. “Limiting Behavior of Posterior Distributions when the Model is Incorrect.” The Annals of Mathematical Statistics 37: 51–58.10.1214/aoms/1177699597Search in Google Scholar
Breymann, W., A. Dias, and P. Embrechts. 2003. “Dependence Structures for Multivariate High-Frequency Data in Finance.” Quantitative Finance 3: 1–14.10.1080/713666155Search in Google Scholar
Brier, G. W. 1950. “Verification of Forecasts Expressed in Terms of Probability.” Monthly Weather Review 78: 1–3.10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2Search in Google Scholar
Bunke, O., and X. Milhaud. 1998. “Asymptotic Behavior of Bayes Estimates under Possibly Incorrect Models.” The Annals of Statistics 26: 617–644.10.1214/aos/1028144851Search in Google Scholar
Chen, X., Y. Fan, D. Pouzo, and Z. Ying. 2010. “Estimation and Model Selection of Semiparametric Multivariate Survival Functions under General Censorship.” Journal of Econometrics 157: 129–142.10.1016/j.jeconom.2009.10.021Search in Google Scholar PubMed PubMed Central
Dawid, A. P. 1984. “Present Position and Potential Developments: Some Personal Views: Statistical Theory: The Prequential Approach.” Journal of the Royal Statistical Society, Series A 147: 278–292.10.2307/2981683Search in Google Scholar
De Luca, G., and A. Carfora. 2014. “Predicting U.S. Recessions through a Combination of Probability Forecasts.” Empirical Economics 46: 127–144.10.1007/s00181-012-0671-4Search in Google Scholar
Demarta, S., and A. J. McNeil. 2005. “The t Copula and Related Copulas.” International Statistical Review 73: 111–129.10.1111/j.1751-5823.2005.tb00254.xSearch in Google Scholar
Drehmann, M., and M. Juselius. 2012. “Improving Early Warning Indicators for Banking Crises Satisfying Policy Requirements. Paper presentation at: Understanding Macro-prudential Regulation, Norges Bank, Oslo, 29–30 November 2012.Search in Google Scholar
Egan, J. P. 1975. Signal Detection Theory and ROC Analysis. New York: Academic Press.Search in Google Scholar
Estrella, A., and F. S. Mishkin. 1996. “The Yield Curve as a Predictor of U.S. Recessions.” Current Issues in Economics and Finance 2: 41–51.10.2139/ssrn.1001228Search in Google Scholar
Estrella, A., and F. S. Mishkin. 1998. “Predicting U.S. Recessions: Financial Variables as Leading Indicators.” The Review of Economics and Statistics 80: 45–61.10.3386/w5379Search in Google Scholar
Fawcett, T. 2006. “An Introduction to ROC Analysis.” Pattern Recognition Letters 27: 861–874.10.1016/j.patrec.2005.10.010Search in Google Scholar
Geweke, J. 2005. Contemporary Bayesian Econometrics and Statistics. Hoboken, New Jersey: John Wiley & Sons.10.1002/0471744735Search in Google Scholar
Gneiting, T., and A. E. Raftery. 2007. “Strictly Proper Scoring Rules, Prediction, and Estimation.” Journal of the American Statistical Association 102: 359–378.10.1198/016214506000001437Search in Google Scholar
Graham, J. R. 1996 . “Is a Group of Economists Better Than One? Than None?” The Journal of Business 69: 193–232.10.1086/209688Search in Google Scholar
Granger, C. W. J., and M. H. Pesaran. 2000. “Economic and Statistical Measures of Forecast Accuracy.” Journal of Forecasting 19: 537–560.10.1002/1099-131X(200012)19:7<537::AID-FOR769>3.0.CO;2-GSearch in Google Scholar
Granger, C. W. J., and R. Ramanathan. 1984. “Improved Methods of Combining Forecasts.” Journal of Forecasting 3: 197–204.10.1002/for.3980030207Search in Google Scholar
Green, D. M., and J. A. Swets. 1966. Signal Detection Theory and Psychophysics. New York: Wiley.Search in Google Scholar
Hastie, T., R. Tibshirani, and J. Friedman. 2001. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer.10.1007/978-0-387-21606-5Search in Google Scholar
Kamstra, M., and P. Kennedy. 1998. “Combining Qualitative Forecasts Using Logit.” International Journal of Forecasting 14: 83–93.10.1016/S0169-2070(97)00056-3Search in Google Scholar
Koop, G. 2003. Bayesian Econometrics. West Sussex, England: John Wiley & Sons.Search in Google Scholar
Krzanowski, W. J., and D. J. Hand. 2009. ROC Curves for Continuous Data. Boca Raton, Florida: Chapman & Hall.10.1201/9781439800225Search in Google Scholar
Lahiri, K., and J. G. Wang. 1994. “Predicting Cyclical Turning Points with Leading Index in a Markov Switching Model.” Journal of Forecasting 13: 245–263.10.1002/for.3980130302Search in Google Scholar
Lahiri, K., and J. G. Wang. 2013. “Evaluating Probability Forecasts for GDP Declines using Alternative Methodologies.” International Journal of Forecasting 29: 175–190.10.1016/j.ijforecast.2012.07.004Search in Google Scholar
Lahiri, K., and L. Yang. 2013a. “Confidence Bands for ROC Curves with Serially Dependent Data.” Working Paper, Department of Economics, State University of New York at Albany, Albany, New York.Search in Google Scholar
Lahiri, K., and L. Yang. 2013b. “Forecasting Binary Outcomes.” In Handbook of Economic Forecasting Volume 2B, edited by A. Timmermann, G. Elliott, 1025–1106. North-Holland, Amsterdam, The Netherlands.10.1016/B978-0-444-62731-5.00019-1Search in Google Scholar
Levanon, G., A. Ozyildirim, B. Schaitkin, and J. Zabinska. 2011. “Comprehensive Benchmark Revisions for The Conference Board Leading Economic Index for the United States.” EPWP 11-06, The Conference Board, New York, December 2011.Search in Google Scholar
Manzato, A. 2007. “A Note On the Maximum Peirce Skill Score.” Weather and Forecasting 22: 1148–1154.10.1175/WAF1041.1Search in Google Scholar
Mashal, R., M. Naldi, and A. Zeevi. 2003. “On the Dependence of Equity and Asset Returns.” Risk 16: 83–87.Search in Google Scholar
McIntosh, M. W., and M. S. Pepe. 2002. “Combining Several Screening Tests: Optimality of the Risk Score.” Biometrics 58: 657–664.10.1111/j.0006-341X.2002.00657.xSearch in Google Scholar
Müller, U. K. 2013. “Risk of Bayesian Inference in Misspecified Models, and the Sandwich Covariance Matrix.” Econometrica 81: 1805–1849.10.3982/ECTA9097Search in Google Scholar
Nelsen, R. B. 2006. An Introduction to Copulas. New York: Springer.Search in Google Scholar
Newey, W. K., and K. D. West. 1987. “A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix.” Econometrica 55: 703–708.10.2307/1913610Search in Google Scholar
Neyman, J., and E. S. Pearson. 1933. “On the Problem of the Most Efficient Tests of Statistical Hypothesis.” Philosophical Transactions of the Royal Society of London, Series A 231: 289–337.10.1098/rsta.1933.0009Search in Google Scholar
Patton, A. J. 2006. “Modelling Asymmetric Exchange Rate Dependence.” International Economic Review 47: 527–556.10.1111/j.1468-2354.2006.00387.xSearch in Google Scholar
Patton, A. J. 2012. “A Review of Copula Models for Economic Time Series.” Journal of Multivariate Analysis 110: 4–18.10.1016/j.jmva.2012.02.021Search in Google Scholar
Patton, A. J. 2013. “Copula Methods for Forecasting Multivariate Time Series.” In Handbook of Economic Forecasting Volume 2B, edited by A. Timmermann G. Elliott, 899–960. North-Holland, Amsterdam, The Netherlands.10.1016/B978-0-444-62731-5.00016-6Search in Google Scholar
Pepe, M. S. 2003. The Statistical Evaluation of Medical Tests for Classification and Prediction. New York: Oxford University Press.Search in Google Scholar
Ramsey, J. B. 1969. “Tests for Specification Errors in Classical Linear Least-Squares Regression Analysis.” Journal of the Royal Statistical Society, Series B 31: 350–371.10.1111/j.2517-6161.1969.tb00796.xSearch in Google Scholar
Ranjan, R., and T. Gneiting. 2010. “Combining Probability Forecasts.” Journal of the Royal Statistical Society, Series B 72: 71–91.10.1111/j.1467-9868.2009.00726.xSearch in Google Scholar
Schervish, M. J. 1989. “A General Method for Comparing Probability Assessors.” Annals of Statistics 17: 1856–1879.10.1214/aos/1176347398Search in Google Scholar
Scotti, C. 2011. “A Bivariate Model of Federal Reserve and ECB Main Policy Rates.” International Journal of Central Banking 7: 37–78.Search in Google Scholar
Stephenson, D. B. 2000. “Use of the ‘Odds Ratio’ for Diagnosing Forecast Skill.” Weather Forecasting 15: 221–232.10.1175/1520-0434(2000)015<0221:UOTORF>2.0.CO;2Search in Google Scholar
Swets, J. A., R. M. Dawes, and J. Monahan. 2000. “Better Decisions through Science.” Scientific American 283: 82–87.10.1038/scientificamerican1000-82Search in Google Scholar
Timmermann, A. 2006. “Forecast Combinations.” In Handbook of Economic Forecasting, edited by G. Elliott, C. W. J. Granger A. Timmermann, 135–196. North-Holland, Amsterdam, The Netherlands.10.1016/S1574-0706(05)01004-9Search in Google Scholar
Trivedi, P. K., and D. M. Zimmer. 2005. “Copula Modeling: An Introduction for Practitioners.” Foundations and Trends in Econometrics 1: 1–111.10.1561/0800000005Search in Google Scholar
Yates, J. F. 1982. “External Correspondence: Decompositions of the Mean Probability Score.” Organizational Behavior and Human Performance 30: 132–156.10.1016/0030-5073(82)90237-9Search in Google Scholar
Zhou, X. H., N. A. Obuchowski, and D. K. McClish. 2002. Statistical Methods in Diagnostic Medicine. New York: John Wiley & Sons.10.1002/9780470317082Search in Google Scholar
Supplemental Material
The online version of this article (DOI: 10.1515/snde-2014-0054) offers supplementary material, available to authorized users.
©2016 Walter de Gruyter GmbH, Berlin/Boston