Bank tellers, masks, and morphs: Individual differences in face recognition

Cognitive Research: Principles and Implications (CRPI) has released the first batch of articles in a special issue dedicated to individual differences in face recognition. Karen Lander, Markus Bindemann, and I have co-organised this special issue. This post is based on the editorial overview that appears with the articles.

In a narrative review of the topic in CRPI, we (i.e., Lander, Bruce and Bindemann) note that, with the exception of work on impairments in face recognition (prosopagnosia), research has only recently begun to investigate why there are such wide variations in individual abilities to perceive and recognise faces. These investigations have raised as many questions as answers about the reasons why some people are so much better than others at recognising faces. Our review also highlighted two specific areas of application–the recruitment and use of ‘super-recognisers’ (SRs) in forensic operations, and the scrutiny of passport or other identity photographs used to gain access to restricted areas. These are areas which a number of the papers in the special issue address.

McCaffery, Robertson, Young and Burton measure performance on a test of face comparison, the Glasgow Face Matching Test (hereafter, GFMT), a test of face memory, the Cambridge Face Memory Test (hereafter CFMT), and a test of recognising familiar faces ‘Before They Were Famous’ (BTWF). McCaffery and colleagues investigate how performance on these tests correlates with each other and with self-assessment of face recognition ability (in a first study), and with other perceptual matching and recognition tasks (in a second study). In general, the face tasks correlated with each other, consistent with the idea that there is a general face perception factor which appears to account for about 25% of performance variance (see earlier work by Verhallen and colleagues along similar lines). Task-specific influences were also found – e.g., people’s self-ratings of face recognition ability correlated only with BTWF, and non-face tasks that required matching correlated only with GFMT.

Thus, McCaffery and colleagues reinforce evidence that some people are better than others at a range of face-perception and recognition tasks, and that such facility cannot be attributed entirely to more general perceptual or memory abilities. While such individual differences appear to support the identification and recruitment of ‘super-recognisers’, the paper by Sarah Bate and colleagues  suggests that more complex, task-specific screening tools may be needed. Bate and colleagues recruited 200 people who thought they were potential SRs and tested them on the long form of the CFMT, and three new and demanding tests of face matching, face memory, and searching crowds for faces resembling a composite image. While a (bare) majority of the 200 showed some degree of consistently good performance across two or more tests, fewer than 50% of them (89 in total) performed well enough on the CFMT alone to support their self-assessment as ‘SRs’. And of these, just 37 were also superior at both the other tests of face memory and matching. Performance on the new test of matching to crowds was not predicted by any of the other tests.

Megan Papesh adds to previous research (e.g., by White and colleagues in 2014) by showing that professionals whose jobs require frequent image-matching, are no better than inexperienced student control participants at matching identities between face images. She recruited over 800 professional notaries and 70 bank tellers and found that they were no better than undergraduate controls at a face-matching task. Moreover, individual differences in the frequency of face-matching in these occupational settings, and years of work experience, did not impact on the professionals’ performance. However, performance was negatively correlated with age, with older participants performing more poorly.

Where scrutinising facial identities is an important component of a job, there may also be scope to recruit people likely to perform more accurately. The article by Balsdon, Summersby, Kemp and White (2018) evaluated the efficacy of using screening tests to select for the job of scrutinising submitted passport photographs for validity. Performance on the three screening tests used (CFMT, GFMT, and a self-report questionnaire) was correlated, but selecting people who scored at the top end of such tests as potential passport image-checkers yielded only modest gains in the authors’ real-world fraud detection test. In contrast, however, pooling decisions from two or more image-checkers led to much more substantial gains, showing that in difficult image-matching tests, using the ‘wisdom of crowds’ approach may be a fruitful way to circumvent problems of human (and machine) error.

The job of checking passport images may become still more challenging as newer methods of fraud become deployed. For example, Robertson and colleagues (2018) describe how a criminal could morph their own image with that of a genuine passport-holder (whose document may have been stolen, or belong to a confederate) and use the morphed image in an application for a passport renewal. The morphed image could match that previous one held by the government well enough to generate a genuine but fraudulently obtained passport. This in turn would resemble the criminal enough to pass detection at a border. Robertson et al. show that there are individual differences in people’s abilities to detect ‘morphed’ faces, and that people can benefit from training on this task. After training, they found a significant correlation between detecting morphed images and detecting mismatches in a difficult (non-morph) face matching task. Like other papers in this special topic, and previous research too (e.g., by Kokje and colleagues and Megreya and Burton), this illustrates how verifying matches and detecting mismatches may involve different skills.

A different kind of fraud can arise from the use of hyper-realistic face masks, as described in the paper by Sanders and Jenkins (and also in a previous post on this blog). Here again, the authors show that there is wide individual variation in ability to spot such fake faces, and here there is no correlation with other face-matching abilities. Examination of what makes some people better than others at this suggests that reliance on local information around the eyes is key to this task, demonstrating that some very specific sub-skills may underlie certain real world applications.

While faces may be the most important key to identity, in many everyday situations there may be information available from bodies as well. An eye-witness to a crime remembers more than just the face of a criminal – they will describe their height, build and perhaps gait too. Noyes, Hill and O’Toole investigate whether screening with the GFMT predicts performance on matching faces (in a different task), matching bodies, and matching bodily motions from point-light displays. Although groups identified as ‘good’ or ‘bad’ face matchers do also differ on performance with bodies, examination of individual differences showed that the GFMT correlated only with the other face-matching test, and not with the two body-matching tests. This underlines that for practical screening and/or theoretical interpretation the individual differences analysis is essential.  Noyes and colleagues argue that this “points to the use of individual differences to inform how or, indeed, whether to apply group analyses” rather than to individual differences being mentioned only as an after-thought.

There is thus considerable evidence that different tasks of face matching and memory are correlated with each other. Some evidence for this correlation was also observed by Matthew Fysh in a further paper in this issue. However, performance of tasks that tap aspects of face identification was not correlated with performance on a task of detecting faces, demonstrating further differentiation of face-related abilities.

We anticipate further papers will join this special topic as revisions of more articles are accepted over the next few weeks.  We expect papers on the topic of individual differences and/or selection of eyewitnesses in line-ups will join the collection surveyed here.

References to in-press papers (not available online at the time of writing)

Balsdon, T., Summersby, S., Kemp, R.I., & White, D. (2018). Improving face identification with specialist teams. Cognitive Research: Principles and Implications, in press

Robertson, D.J., Mungall, A., Watson, D.G., Wade, K.A., Nightingale, S.J., & Butler, S. (2018).  Detecting morphed passport photos: a training and individual differences approach. Cognitive Research: Principles and Implications, in press

The Psychonomic Society (Society) is providing information in the Featured Content section of its website as a benefit and service in furtherance of the Society’s nonprofit and tax-exempt status. The Society does not exert editorial control over such materials, and any opinions expressed in the Featured Content articles are solely those of the individual authors and do not necessarily reflect the opinions or policies of the Society. The Society does not guarantee the accuracy of the content contained in the Featured Content portion of the website and specifically disclaims any and all liability for any claims or damages that result from reliance on such content by third parties.

You may also like