Abstract

We propose a novel method for Markov regime switching (MRS) model estimations by spectral clustering hidden Markov model (SC-HMM). The proposed SC-HMM exploits the Markov property of hidden states and utilizes pairwise feature similarities for latent state identifications. It can be applied to general hidden Markov models (HMMs) with continuous observations. In contrast to the maximum likelihood estimation (MLE), SC-HMM predicts latent states and yields conditional distribution statistics without knowledge of types of conditional distributions. To illustrate, SC-HMM is first applied to a simple HMM with discrete observations. We consider the MRS model estimation with continuous observations to further demonstrate SC-HMM. Specifically, based on local observations, we propose a set of features for the MRS estimation. A similarity matrix is determined from derived features and spectral clustering predicts latent states. Conditional distribution statistics and transitional probabilities are estimated based on identified latent states. By conducting simulation studies on both two-state and three-state MRS estimations, we demonstrate that, in comparison with MLE, the proposed SC-HMM is more robust. Furthermore, we demonstrate the validity of SC-HMM by estimating a two-state MRS from the S&P/TSX Composite Index daily and monthly data from 1977 to 2014.

Keywords

Notes

Acknowledgements

Yuying Li acknowledges funding from the National Sciences and Engineering Research Council of Canada. Kai Zheng acknowledges funding from the National Natural Science Foundation of China (No. 71671146). Weidong Xu acknowledges funding from NSFC (No. 71771197), NSFC project under Grant (No. 71821002) and Educational Commission of Zhejiang Province of China (No.Y201329832). Authors also acknowledge anonymous referees for their comments and suggestions which have led to improvement in the presentation of the paper.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Baum, L. E., Eagon, J. A., et al. (1967). An inequality with applications to statistical estimation for probabilistic functions of markov processes and to a model for ecology. Bulletin of the American Mathematical Society, 73(3), 360–363.CrossRefGoogle Scholar