Bookmark

OpenURL

Abstract

We present a method being developed to extract information about characters ’ emotions in films. It is suggested that this information can help describe higher levels of multimedia semantics relating to narrative structures. Our method extracts information from audio description that is provided for the visually-impaired with an increasing number of films. The method is based on a cognitive theory of emotions that links a character’s emotional states to the events in their environment. In this paper the method is described along with some preliminary evaluation and discussions about the kinds of novel video retrieval and browsing applications it may support.

Citations

...tion, proposed by Ortony and colleagues, treats emotions as agents’ appraisals of actions, events and objects in their environment – where their appraisals are made with respect their important goals =-=[4]-=-. In these terms, if someone is ‘delighted’ it is because something unexpected has happened that helps towards one of his or her important goals; for example, you long for a sports car and then win on...

...erms of extracting information directly from digital film data, interesting approaches have been described for recovering information about film narrative from visual and aural patterns in video data =-=[3]-=-. 3. METHOD Our method is to scan for possible descriptions of visibly manifested emotions in time-coded audio description and to classify them: here we use the 22 types of emotion proposed by [4] for...

...ary to other research that has dealt with film data in multimedia systems. A system was developed to browse between intervals in a film via a semantic network that included cause-effect relationships =-=[5]-=-. Other work explicitly introduced theories 300 related to narrative and story threads in a system to browse multimedia stories, including films [1]. In terms of extracting information directly from d...

...ic network that included cause-effect relationships [5]. Other work explicitly introduced theories 300 related to narrative and story threads in a system to browse multimedia stories, including films =-=[1]-=-. In terms of extracting information directly from digital film data, interesting approaches have been described for recovering information about film narrative from visual and aural patterns in video...

... invaluable as a means for improving access to information for the visually impaired, audio description is also a promising source of information for generating descriptions of semantic video content =-=[6]-=-. We present a method to extract information about characters’ emotions in films from audio description; this method is grounded in a cognitive theory of emotion. We then discuss how the information a...

... in space and time, where the events are linked by cause-effect relationships. For films this definition has been elaborated so that the agents of cause-effect relationships are said to be characters =-=[2]-=-. When we watch a film we make sense of and anticipate the unfolding events that are depicted on-screen, based at least in part on what we think about characters’ cognitive states, e.g. their goals, b...