Faces are the most fascinating objects for human beings. We are never tired of looking at faces, a fact used heavily by advertising companies. In the course of our childhood, we develop a remarkable expertise at deciphering the most subtle aspects of a face, not only do we recognize identity or sex, but we also notice, for example, signs of tiredness, sadness or age.

Main projects:

While we are expert in face recognition in general, we process and retrieve information about familiar and unfamiliar faces differently. We use preferably the inner features for recognizing familiar faces, while for unfamiliar faces we pay more attention to and keep in memory more likely extra-facial information like hairdo, glasses or beards. In one project, I investigate the recognition of personally familiar faces, as they are the faces that we remember best. With these faces, we can test how precisely facial information related to sex, race or identity is memorized. I concentrate on those aspects of faces, as we use those attributes most osten to describe or classify faces. Our results give insight about how very familiar faces are represented in memory. They reveal that facial information regarding sex and race are represented only very coarsely in memory, while those linked to identity are encoded very precisely.

Another line of study (in collaboration with the Space and Body Perception group) uses the advantages of virtual reality to investigate face recognition under more natural conditions. Most studies so far tested isolated static faces. In our project, observers moved physically in a virtual room to look at the faces of life-size avatars. We compared the recognition performance of this active group to that of other groups with different learning conditions. Overall, the active group performed better than the other groups.

In collaboration with Mintao Zhao, and other colleagues, additional projects investigate, among others, holistic processing of faces, the other-race effect and the influence of voices on face recognition.

What gives a face its ethnicity? We can quickly and easily judge faces in terms of their ethnicity. In a series of studies, we investigate whether one or another part of the face (eyes, mouth…) has more influence on perceived ethnicity of that face. This work is done in collaboration with Korea University (BioCyb Lab in the Department of Brain and Cognitive Engineering) and involves participants of different cultural background and expertise in terms of face ethnicities.

Influence of body size on face recognition. The concept of “Embodied Cognition” implies that our own bodies, the way we act with our bodies, and the way our bodies “fit” into the environment, should all have important implications for our mental representation of the world. Thus the question arises whether we represent and/or process faces in a different way depending on our body size. This work is done in collaboration with Ian Thornton (University of Malta, Malta) and Betty Tesch (Mohler).

Current project in more details:

Personally familiar faces: Higher precision of memory for idiosyncratic than for sex or race facial information

Introduction

We process and retrieve information about familiar and unfamiliar faces differently. We use preferably the inner features for recognizing familiar faces, while for unfamiliar faces we keep in memory more likely extra-facial information like hairdo, glasses or beards1. Testing memory of very familiar faces allows us to test how precisely different types of facial information are memorized.

Goals

We investigate whether facial information related to either sex, race or identity might be remembered more precisely than the others. We concentrate on those aspects, as they represent some attributes that we use most commonly to describe or classify faces. The results will give insight about how very familiar faces are represented.

Methods

The faces of members of the department were used as personally familiar test faces and the members of the department were our participants. The veridical faces were manipulated2 in increasing manner in four different ways: they were (1) morphed with other identities, (2) caricatured and anti-caricatured, (3) made more feminine looking and more masculine looking and (4) made more Caucasian looking and more Asian looking. In each test trial, a veridical face was shown with its distracters (the faces obtained with one of the four manipulations). Participants had to find the veridical face among the distracters.

Initial results

Figure 1 shows that participants chose the veridical face most frequently when the distracters were identity morphs, while this was not the case for the other manipulations.

Initial conclusion

Our results reveal that for personally familiar faces, their facial information regarding sex and race are represented only very coarsely in memory, while those linked to identity are encoded very precisely.

Bülthoff I and Newell FN (May-2000): There is no categorical effect for the discrimination of face gender using 3D-morphs of laser scans of heads, Annual Meeting of the Association for Research in Vision and Ophthalmology (ARVO 2000), Fort Lauderdale, FL, USA, Investigative Ophthalmology & Visual Science, 41(4) S225.

Zhao M and Bülthoff I (November-6-2013) Invited Lecture: The other-race effect in face recognition is sensitive to face format at encoding, The University of Hong Kong: Department of Psychology Seminar, Hong Kong, China.

Bülthoff I (October-24-2012) Invited Lecture: Face Perception: Using a morphable face model to determine what makes a face look Asian or Caucasian and what makes a face attractive and why?, Seoul National University: Department of Computer Science and Engineering, Seoul, South Korea.