We investigate how affective factors influence dialogue patterns and whether this effect may be described and recognized by HMMs. Our goal is to analyse the possibility of using this formalism to classify users’ behavior for adaptation purposes. We present some preliminary results of an ongoing research and propose a discussion of open problems.