Prioritized Detection of Personally Familiar Faces.

We investigated whether personally familiar faces are preferentially processed in conditions of reduced attentional resources and in the absence of conscious awareness. In the first experiment, we used Rapid Serial Visual Presentation (RSVP) to test the susceptibility of familiar faces and faces of strangers to the attentional blink. In the second experiment, we used continuous flash interocular suppression to render stimuli invisible and measured face detection time for personally familiar faces as compared to faces of strangers. In both experiments we found an advantage for detection of personally familiar faces as compared to faces of strangers. Our data suggest that the identity of faces is processed with reduced attentional resources and even in the absence of awareness. Our results show that this facilitated processing of familiar faces cannot be attributed to detection of low-level visual features and that a learned unique configuration of facial features can influence preconscious perceptual processing.

Introduction

The capacity to detect ecologically relevant stimuli quickly has adaptive advantages. Previous work has demonstrated that stimuli that signal threat are processed preferentially in conditions of increased attentional load and without awareness [1], [2]. Perceiving socially relevant stimuli quickly, including those that can facilitate social exchanges in addition to those that signal threat, is essential for adaptive behavior. Faces convey important information for non-verbal communication. A bias toward faces is already present early in life [3]. Upright faces are detected preferentially, relative to inverted faces, even in the absence of conscious awareness [4], [5]. Signals expressed by faces that manifest interest, the desire to catch one’s attention, or the intention to engage in a social interaction such as eye gaze and head direction also are processed in the absence of conscious awareness [6], [7].

Face identity plays a central role in detection of in-group members and friends and plays a central role in the way we approach others. We wanted to investigate whether detection of personally familiar faces involves mechanisms that require fewer attentional resources than do mechanisms for detection of faces of strangers and whether these mechanisms operate even when faces are not consciously visible. We conducted two behavioral experiments on detection of personally familiar faces and faces of strangers while manipulating the attentional load and awareness of the stimuli.

In the first experiment we used a Rapid Serial Visual Presentation (RSVP) to measure detection rate for personally familiar faces as compared to faces of strangers during the attentional blink. The attentional blink is characterized by reduced detection of a second visual target (T2), embedded in a stream of rapidly presented visual stimuli, when it follows an initial target (T1) after an interval of 200–500 ms [8], [9]. Emotionally salient stimuli such as faces with fearful expression or emotionally meaningful words are less affected by the attentional blink than are neutral faces and words [10], [11]. Familiar faces represent a class of socially relevant stimuli. The capacity for quickly identifying friends not only has an important ecological value but also determines the way we approach and interact with others. For example, face categorization is faster when faces are personally familiar [12]. Better detection of one class of stimuli, as compared to another, during the attentional blink indicates that processing of the favored stimuli requires fewer attentional resources. Such processing facilitates orientation of attention to prioritized objects and events and extraction of information that may be important for adaptive behavior. Thus, better detection of familiar faces during the attentional blink would suggest learned processes that facilitate directing cognitive resources to in-group conspecifics.

In the second experiment we used continuous interocular flash suppression to render stimuli invisible. Interocular suppression with binocular rivalry is a well-established method to manipulate awareness [13], [14], [15]. Using this technique, we assessed whether personally familiar faces break through suppression faster than faces of strangers.

Our two experiments provide convergent results on prioritized detection of familiar faces. Consistent with our hypothesis, the results show that personally familiar faces, as compared to faces of strangers, are more readily detected during the attentional blink and break through interocular suppression faster. These findings suggest that personally familiar faces are recognized by processes that operate outside of the focus of attention and without visual awareness. Such enhanced detection may facilitate allocation of attention and awareness to these socially salient faces.

Experiment 1 - Rapid Serial Visual Presentation

Methods

Subjects

Thirteen healthy, right-handed volunteers with normal or corrected-to-normal vision and no record of neurological or psychiatric illness participated in the study (7 male, 6 female, mean age 26±7 year). Before the experiment, each participant signed an informed consent approved by the local ethical committee (IRB protocol 21200). Subjects were compensated for their participation.

Stimuli

Faces of different categories of mammals such as bears, dogs, non-human primates, and lions were used as distracters (fillers). Human faces were presented as targets. The first target (T1) was an inverted face and the second target (T2) was an upright face that was either a personally familiar face or the face of a stranger (Figure 1). The inverted face (T1) was always a face of a stranger different from those used as T2. We chose inverted faces of strangers as T1 to make the nature of the task, human face detection, clear, and to make T1 and T2 clearly distinct. Inverted faces evoke strong responses in the face-selective occipital and fusiform cortices, suggesting that they use face-specific resources, even though they do not evoke a representation of individual identity that is as distinct [16]. Thus, inverted faces appear to engage face-specific cognitive resources.

Figure 1

Attentional blink paradigm.

Faces of different categories of mammals were used as distracters while human faces were presented as targets. The first target (T1) was an inverted face (always a face of a stranger different from those used as T2) and the second target (T2) was an upright face that was either a personally familiar face or the face of a stranger. Stimuli were presented for 80 ms with no interval between stimuli.

Participants provided pictures of six personally familiar faces. Personally familiar individuals were chosen among relatives and long term friends with whom the participants reported to have a good relationship. Two different images of each individual were used, for a total of 12 familiar face images. Faces of strangers for each subject were chosen from the familiar faces for the other participants and were age and gender matched with that subject’s personally familiar faces. Faces were converted to grayscale, cropped to remove the hair, body parts, clothing, and background, then superimposed on a uniform gray background using Adobe Photoshop (San Jose, CA) to minimize pictorial memory for the stimuli. Images were normalized to have the same mean luminance and contrast. Subjects shown in Figure 1 gave written informed consent, as outlined in the PLOS consent form, to publication of their photographs.

Because we use images of personally familiar faces in both Experiments 1 and 2, we require subject’s cooperation for identifying familiar individuals, making it impossible, or at best very difficult, to include images of unexpected familiar faces among the stimuli. Our results, therefore, are relevant for detection of faces when subjects are aware of the identities to be detected but not for detection of unexpected familiar identities.

Stimuli were presented with SuperLab (Cedrus, San Pedro, CA) with a viewing distance of 80 cm from the monitor (visual angle 6°).

The stimuli were presented in 1200 msec blocks of 15 face images each. Each face image was presented for 80 msec with no interval between stimuli. Each trial began with a fixation cross at the center of the screen for 1 s followed by a block of 15 face images and ended with a small square that indicated the time for the response.

Trials

There were seven trial types: 1–4) T1 followed by T2 after one to four fillers (stimulus onset asynchronies - SOAs - of 160 ms, 240 ms, 320 ms, and 400 ms), 5) T1 only, 6) T2 only, 7) catch trials (no targets). For each trial type with T2 stimuli (trial types 1–4 and 6) 30 trials had a personally familiar face T2 and 30 trials had an unfamiliar face T2. T1 was presented after the third to sixth filler stimulus. An interval of 2 sec followed each trial to allow the participants to respond.

Each subject saw 30 trials for each lag for the T1+T2 (familiar face) condition, 30 trials for each lag of the T1+T2 (unfamiliar face) condition, 30 trials for the T2 only (familiar face) condition, 30 trials for the T2 only (unfamiliar face) condition, 120 trials for the T1 only condition, and 120 catch trials (no T1 or T2). Images for individual faces were assigned randomly to each condition and lag.

Task

Participants were asked to indicate whether they detected human faces. Participants responded by pressing one of three keys on a keyboard: 1 when they saw only T1; 2 when they saw only T2; 3 when they saw T1+T2; and no response for catch trials. We chose to use inverted faces as T1 to ensure that subjects could distinguish T1 from T2 regardless of whether they could discern the identities of the faces.

A practice session preceded the experiment. Data from the practice session were not analyzed.

Statistics

We calculated detection rates for upright faces (T2) during the attentional blink using only trials on which the inverted face (T1) was detected. We analyzed T2 detection rates during the attentional blink using a two-way ANOVA with lag (4 SOAs) and familiarity (familiar versus unfamiliar) as factors.

Results and Discussion

We found significant effects for familiarity (F1, 84 = 21.4, p<0.0001) and lag (F3, 84 = 18.9 p<0.0001, Figure 2). The interaction between familiarity and lag, however, was not significant (F1, 84 = 1.6, n.s. p>0.1).

Figure 2

Results for each lag during the attentional blink.

Personally familiar faces were detected more frequently than were faces of strangers during the attentional blink.

Personally familiar faces were detected more frequently than were faces of strangers during the attentional blink, indicating that detection of familiar faces requires fewer attentional resources than does detection of unfamiliar faces.

These results suggest that detection of familiar faces is more robust during the attentional blink than is detection of unfamiliar faces and, thus, reflects a process that requires fewer attentional resources. The difference between familiar and unfamiliar face detection was significant for the intermediate SOAs (240 and 320 ms, t12 = 3.22 and 3.38, respectively, p<0.01 in both cases) and not significant for the shortest and longest lags. Detection rates for unfamiliar faces do not appear to have reached asymptote at an SOA of 400 ms, suggesting that the attentional blink was not fully resolved over the SOAs that we used.

A bias toward quick detection of personally familiar faces and stimuli that signify threat has been reported in the literature. In our experiment, we wanted to test if familiar faces are more resistant to the attentional blink than are faces of strangers. The most likely explanation for the attentional blink is a temporary engagement of attentional resources by the first target, reducing the resources that are available to process the second target [8], [9]. The attentional blink can be attenuated when the second target is an emotionally relevant stimulus such as a fearful face, as compared to a face with a neutral expression [11], [17], [18]. Faces with fearful expressions can modulate neural activity in brain areas that are involved in processing emotional stimuli even with reduced attentional resources and lack of awareness [1], [2], [4], [5], [19], [20]. These findings suggest the existence of mechanisms for quick recognition of stimuli that may signal threat. An alternative route that bypasses the visual ventral temporal pathway has been proposed for fast processing of this type of stimuli [21]. The existence of such a pathway in processing affective stimuli in humans has been questioned by others who suggest that the visual pathway may be sufficient for fast processing of these stimuli – even with reduced attentional resources and awareness – and, further, propose a role for top-down biasing of visual cortex involving frontal-parietal regions [22]–[24]. An alternative direct frontal-occipital pathway has been proposed to explain unconscious face processing in normal cognition and covert recognition in prosopagnosics [25].

The weaker susceptibility of familiar faces, as well as of threatening stimuli, to the attentional blink does not imply, of course, that similar mechanisms are used to process these stimuli, even though they are both socially relevant. For example, we have shown in a neuroimaging experiment that personally familiar faces induce a decrease in the amygdala response [26] unlike faces with fearful expression, which induce an increased response in this structure [27]. Our behavioral results cannot identify the neural systems involved during the attentional blink with personally familiar faces. Overlearned familiarity with the visual aspects of familiar faces, retrieval of person knowledge or both could play a fundamental role. Further experiments are needed to address this point.

Our results suggest that personally familiar faces are detected by mechanisms that require less attention than are required for unfamiliar faces, indicating that facilitated processing of socially meaningful stimuli can be learned through experience. To investigate further the extent to which familiar face detection is prioritized, we ran a second experiment to evaluate detection of familiar faces in condition of lack of awareness.

Experiment 2 - Continuous Interocular Flash Suppression

20 volunteers (14 females; mean age: 23±4) participated in this experiment. Participants had no history of neurological or psychiatric diseases and had normal or corrected to normal vision. Participants gave written informed consent approved by the local ethical committee and were compensated for their participation.

All participants were asked to provide contacts for 4 friends with whom they reported to have a good relationship and had known for more than a year. To ensure that all the stimuli were equal in terms of image quality, we made pictures of the friends of participants in a photo studio with identical lighting and camera placement and settings. To ensure that the unfamiliar control faces were truly strangers to the participants and that the pictures were of the same quality as the pictures of the familiar faces, we took pictures of students at another university (University of Vermont), where we set up a photo studio that was identical to the one at Dartmouth College. Pictures of strangers were matched in gender, age and race with the personally familiar faces. Six different face images of each of the four friends and four strangers were selected. Face images were in color, presented in an oval mask, subtending 1.6 degrees of horizontal visual angle and 2 degrees of vertical visual angle, on a gray surround. The subject shown in Figure 3 gave written informed consent, as outlined in the PLOS consent form, to publication of her photograph.

Figure 3

Continuous Flash Suppression (CSF) paradigm.

Different high contrast collages of colored shapes were presented to one eye at 10 Hz. A phase-scrambled image that faded into an intact face image over 1 s was presented to the other eye. After the intact face was at full opacity for 1 s, the suppressing stimuli slowly faded to a gray square.

Suppressing stimuli were brightly colored, high contrast collages of different shapes (rectangular and curved figures), subtending 3 degrees of visual angle horizontally and vertically, that changed every 100 ms (Figure 3). The dynamic suppressing stimuli and the target stimuli were presented in central vision on different monitors with a mirror haploscope, mounted on a chin rest.

Each trial was preceded by 1s of a gray screen with a fixation cross. For the first 1 to 2 s of a trial, dynamic suppressing stimuli were presented at 10 Hz to one eye, and a phase-scrambled face image, with the same dimensions as the intact face images, was presented to the other eye (Figure 3). Phase-scrambled face images matched the intact faces in terms of spatial frequencies and luminance. The target face was faded in over 1 s by gradually increasing its opacity from 0% to 100%. Detection time was measured starting from the fading-in of faces. Beginning one second after the face image was at 100% opacity (2 to 3 s after trial onset), the contrast of the suppressing stimuli progressively decreased over 3.5 s to zero (a gray square). Each trial ended with presentation of the face image with no suppressing stimulus for 2s. For each subject, 96 trials had familiar faces and 96 trials had unfamiliar faces. We included 72 catch trials to prevent premature responses before true breakthrough. On catch trials, the phase-scrambled image was not replaced with an intact face image, and the trial ended with the phase-scrambled image and no suppressing stimulus.

Subjects were instructed to respond by pressing the space bar on a keyboard as soon as they saw a face or any part of a face. Response times were measured relative to the time when a face began to fade in. Subjects were instructed to make no response on catch trials.

We compared reaction times for detection of familiar faces as compared to faces of strangers. For each subject, we calculated the median reaction time for each of the two conditions. We used a matched-pair t-test (two-tailed) to assess the significance of the difference in time to break through interocular suppression for personally familiar faces as compared to faces of strangers.

We compared how long it took for faces of friends and faces of strangers to break through continuous flash interocular suppression. Faces of friends were detected 91±40 (SE) ms faster (1505 ms versus 1596 ms, t19 = 2.28, p<0.05, two-tailed) than were faces of strangers (Figure 4).

Figure 4

Results of the CSF experiment.

Faces of friends were detected 91±40 SE ms faster than were faces of strangers.

Continuous flash interocular suppression renders stimuli invisible using binocular rivalry with a high energy, rapidly changing stimulus presented to one eye [13]. If the stimuli to the two eyes are of equivalent salience, awareness of stimuli fluctuates spontaneously. With continuous flash interocular suppression it is possible to prevent one image to reach awareness for longer periods of time. We used continuous flash suppression so that onset of a new face image was not immediately visible, thus allowing processing of that image without awareness for an extended period of time.

Because a stimulus is subjectively invisible prior to breakthrough, any factor that facilitates faster breakthrough indicates processing that occurs without conscious awareness. Previous reports of faster breakthrough for some faces as compared to others have varied facial attributes that are presumably mediated by the more dorsal part of the distributed neural system for face perception [28]–[30], involving the superior temporal sulcus. These attributes have been fearful expression [5], [31], [32], head angle [7], and eye gaze [6]. By contrast, faster breakthrough based on identity is presumably mediated by the more ventral part of the distributed system for face perception, involving the fusiform gyrus and anterior temporal cortex [33], [34], with possible involvement of brain areas for social cognition, such as the medial prefrontal cortex and the temporoparietal junction [26], [29], [35]–[38]. The precise delineation of the neural systems that mediate facilitated processing of familiar faces requires further study, but it appears to be a different system than the system for facilitated processing of fearful faces.

General Discussion

We conducted two experiments to investigate if personally familiar faces are processed in a prioritized way when attentional resources are reduced and when one is not consciously aware of the face image. In the first experiment we compared detection rate for personally familiar faces versus faces of strangers during the attentional blink. In the second experiment we measured how quickly personally familiar faces and faces of strangers break through interocular flash suppression. The results of the first experiment showed that familiar faces are more readily detected during the attentional blink than are faces of strangers. The results of second experiment showed a faster break through for personally familiar faces as compared to faces of strangers. Our findings indicate that faces that are personally familiar are processed preferentially in conditions of decreased attentional resources and lack of awareness.

Quick recognition of familiar people has an adaptive value and is essential for effective social interactions. A mechanism for recognition of familiar conspecifics is widespread in the animal kingdom. For example, monkeys are able to recognize the identity of other individual group members by their call and respond according to their social status [39]. In humans, recognition of a familiar individual is associated with the spontaneous retrieval of person knowledge about that individual [40]. Recognizing that a face is familiar, as compared to simply detecting a face, requires approximately an additional 100 ms of processing (according to Barragan-Jason et al.’s [41], [42] estimate). We have proposed that recognition of familiar individuals is the result of activation of a distributed neural system that involves not only the visual cortex but also areas that are implicated in nonvisual cognitive functions, such as the medial prefrontal cortex, the temporo-parietal junction, the precuneus, and the anterior temporal cortex – areas that play roles in Theory of Mind [43], [44] and autobiographical memory, and the amygdala and anterior insula – areas that play a role in emotional responses [26], [29], [35], [37], [40], [45], [46]. Activation of these systems may be due to the spontaneous retrieval of person knowledge and the emotional response that support successful recognition of familiar individuals. The higher detection rate for familiar faces during the attentional blink (Experiment 1) and processing of familiar faces without awareness (Experiment 2) suggest that part or all of the systems that mediate recognition of familiar individuals may be activated independently of explicit visual recognition. This hypothesis finds support also from the neuropsychological literature. Prosopagnosia is a neurological disorder characterized by the inability to explicitly recognize the identity of a familiar person based on the visual appearance of the face and in the absence of other cognitive impairments such as memory deficits or nonface object recognition [47]. Patients affected by this disorder, however, implicitly recognize familiar faces despite their inability to recognize them explicitly [48]–[50], as evidenced by normal augmentation of skin conductance response to familiar as compared to unfamiliar faces. Further behavioral evidence for implicit recognition of familiar faces comes from studies using a forced choice familiarity task, a forced choice cued task and a priming task [51]–[52]. The data from prosopagnosia indicate that detection of familiar individuals can happen without conscious visual recognition. Our data provide further support for the hypothesis that recognition of familiar individuals involves processes that do not require conscious awareness.

Signals that communicate threat also are processed at a preconscious level. Examples of such signals include faces with fearful expressions, vocal expressions of fear, bodily expressions of anger, spiders and snakes [4], [5], [10], [11], [53]. This capacity could be mediated by a separate pathway in the visual system for responding quickly to stimuli and events that might compromise our well-being [21]. A subcortical pathway through the superior colliculus and pulvinar has been hypothesized that mediates a coarser but faster processing of affective visual stimuli [20]. The existence of a subcortical pathway for quick detection of relevant stimuli has been questioned and alternatives that involve processing relevant stimuli through direct cortico-cortical connections have been proposed [25], [54]. Expressions of emotion such as fear activate the amygdala under conditions of increased attentional load [2] and in the absence of awareness [1]. The expression of fear alters the image of a face with a change in shape of the eyes, the eyebrows and the mouth. One of these features, exposure of the whites of the eyes, could be a simple, low spatial frequency feature that mediates rapid detection of fear without awareness [19]. More recent findings indicate that other social cues associated with faces, such as head angle or direct eye gaze, also are detected without awareness [6], [7]. Rapid detection of these facial cues could also be mediated by simple, low spatial frequency features, for example the central placement of the iris within the sclera or the central placement of the eyes and mouth in the oval of the face. In our experiment, we tightly controlled the quality of the stimuli. Pictures of familiar faces and control faces were matched on age, gender, and race, and were equated in terms of dimensions, light conditions and image quality. Therefore, our results cannot be ascribed to low-level feature differences between familiar and unfamiliar faces. Instead, the distinction between familiar and unfamiliar must be based on learned discrimination of facial configurations that are unique to individuals. Our results highlight that a socially-salient perceptual discrimination that is learned through experience is processed without awareness.

In conclusion the results of the present experiments provide evidence for preferential processing of stimuli that are socially salient and do not signal threat. Our results indicate that mechanisms for detection of socially-relevant stimuli with reduced attentional resources and even without conscious awareness can be due to learning of complex stimulus configurations.