Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

Models of human control strategy (HCS), which accurately emulate dynamic human behavior, have far reaching potential in areas ranging from robotics to virtual reality to the intelligent vehicle highway project. A number of learning algorithms, including fuzzy logic, neural networks, and locally weighted regression exist for modeling continuous human control strategies. These algorithms, however, may not be well suited for modeling discontinuous human control strategies. Therefore, we propose a new stochastic discontinuous modeling framework, for abstracting human control strategies, based on hidden Markov models. In this paper, we first describe the real-time driving simulator which we have developed for investigating human control strategies. Next, we demonstrate the shortcomings of a typical continuous modeling approach in modeling a discontinuous human control strategy. We then propose an HMM-based method of modeling discontinuous human control strategies, and show that the proposed controller overcomes these shortcomings and demonstrates greater fidelity to the human training data. We conclude the paper with further comparisons between the two competing modeling approaches.