Enhanced subliminal emotional responses to dynamic facial expressions.

Emotional processing without conscious awareness plays an important role in human social interaction. Several behavioral studies reported that subliminal presentation of photographs of emotional facial expressions induces unconscious emotional processing. However, it was difficult to elicit strong and robust effects using this method. We hypothesized that dynamic presentations of facial expressions would enhance subliminal emotional effects and tested this hypothesis with two experiments. Fearful or happy facial expressions were presented dynamically or statically in either the left or the right visual field for 20 (Experiment 1) and 30 (Experiment 2) ms. Nonsense target ideographs were then presented, and participants reported their preference for them. The results consistently showed that dynamic presentations of emotional facial expressions induced more evident emotional biases toward subsequent targets than did static ones. These results indicate that dynamic presentations of emotional facial expressions induce more evident unconscious emotional processing.

INTRODUCTION

The induction of emotion in the absence of conscious awareness of the stimulus evoking such emotion has long been a subject of great interest (Pribram and Gill, 1976; Zajonc, 1980). Because such emotional processing may circumvent the supervision of consciousness, it may have great impact on our daily social behaviors (Ferguson and Bargh, 2004). From an evolutionary perspective, emotional processing without conscious awareness compared with processing with conscious awareness would be expected to have longer history and to confer an adaptive advantage by facilitating rapid and immediate reactions to biologically significant stimuli, such as predators.

Several behavioral studies have used subliminal presentations of emotional facial expressions in the context of the affective priming paradigm to investigate unconscious emotional processing (e.g., Murphy and Zajonc, 1993; Murphy et al., 1995; Rotteveel et al., 2001; for reviews, see Eastwood and Smilek, 2005; Winkielman, 2010). In a typical use of this paradigm, a facial expression depicting a negative or positive emotion is flashed briefly as a prime, and an emotionally neutral target (e.g., an ideograph) is then presented. Participants are asked to emotionally evaluate the target. Previous studies have reported that evaluations of the target were negatively biased by unconscious negative compared with positive primes (Murphy and Zajonc, 1993; Murphy et al., 1995; Rotteveel et al., 2001). This effect has been interpreted as evidence that unconscious emotion can be elicited and that it affects the evaluation of unrelated targets (Murphy and Zajonc, 1993).

However, the subliminal priming paradigm did not always yield robust and strong effects. Several previous studies reported either the null effects of subliminally presented facial expressions (e.g., Kemps et al., 1996; Raccuglia and Phaf, 1997; Paul et al., 2012) or even a contrast effect (Kobylinska and Karwowska, 2007). Although Murphy and Zajonc (1993) reported that affective priming is most potent when it is subliminal (also see, Sweeny et al., 2009), the use of a short presentation time for stimuli, which is necessary to prevent conscious awareness, may prevent the use of unconscious processing in response these stimuli. Furthermore, the optimal temporal threshold for the presentation of stimuli is difficult to assess under a subliminal condition (Pessoa, 2005). Therefore, it would be helpful to develop a new experimental method that would facilitate a stronger and more robust subliminal effect of emotional facial expressions to clarify the psychological mechanisms underlying this phenomenon.

The presentation of dynamic facial expressions may be relevant in this regard, as these are more natural and powerful cues in real-life social interactions than are static expressions. From an evolutionary perspective (Darwin, 1872), human minds are programmed to process dynamic facial expressions of conspecifics more efficiently than they process static ones, which are artificial signals or products of technology. Consistent with this notion, several behavioral studies have indicated that dynamic facial expressions induced more evident behavioral reactions, such as emotion elicitation (Sato and Yoshikawa, 2007a), perception (Yoshikawa and Sato, 2008), and facial mimicry (Sato and Yoshikawa, 2007b), compared with static ones. The advantages of using dynamic compared with static facial expressions to induce behavioral reactions have even been shown in newborn infants (Vinter, 1986). These data suggest the advantage of using dynamic versus static facial expressions to elicit behavioral reactions, including unconscious emotions.

Neuroscientific evidence has also suggested the appropriateness of dynamic presentations for eliciting unconscious processing of emotional facial expressions. Previous neuroimaging studies have shown that subliminal presentations of emotional facial expressions activated the amygdala (e.g., Whalen et al., 1998; Suslow et al., 2013), which is more active when viewing dynamic than static facial expressions (e.g., LaBar et al., 2003; Sato et al., 2004). Neuroimaging studies have also suggested that the processing of unseen emotional facial expressions is related to the subcortical visual pathway to the amygdala, including the superior colliculus (e.g., Morris et al., 1999, 2001), and the superior colliculus was shown to be more sensitive to dynamic compared with static visual information (Schneider and Kastner, 2005). Based on these findings, we hypothesized that dynamic presentations of facial expressions would enhance subliminal emotional effects.

To test this hypothesis, we developed the dynamic subliminal affective priming paradigm. Fearful or happy facial expressions were presented dynamically or statically for 20 and 30 ms, followed by a mosaic mask (Figure ). Then, nonsense target ideographs were presented, and participants evaluated the targets. Given that ample evidence indicates that the subcortical visual pathway is dominant in processing the peripheral compared with the central visual field (Waleszczyk et al., 2004), we presented the prime stimuli in the left or right peripheral visual field. To ensure the robustness of the phenomenon, we presented the stimuli at two different speeds. We predicted that fearful and happy facial expressions would affect participants’ reactions to the targets to a greater extent when they were dynamic compared with when they were static.

An example of dynamic facial expressions .

MATERIALS AND METHODS

PARTICIPANTS

Twenty-three healthy volunteers participated in Experiment 1 (10 females and 13 males, mean ± SD age, 21.6 ± 2.8 years), and 22 others participated in Experiment 2 (eight females and 14 males, mean ± SD age, 21.6 ± 2.4 years). All participants were Japanese, and none was familiar with Korean characters (the target ideographs). All participants were right handed, as assessed by the Edinburgh Handedness Inventory (Oldfield, 1971), and had normal or corrected-to-normal visual acuity. All were ignorant of the purpose of the experiment. Written informed consent was obtained from all participants after the experimental procedures had been fully explained. This study was approved by the local ethics committee of the Primate Research Institute, Kyoto University.

EXPERIMENTAL DESIGN

The experiment was constructed as a within-subjects three-factorial design, with presentation condition (dynamic/static), emotion (negative/positive), and visual field (left/right) as factors.

STIMULI

The raw materials of the prime stimuli were grayscale photographs of the faces of 10 Caucasian individuals (five females and five males) chosen from a standard set (Ekman and Friesen, 1976) depicting fearful, happy, and neutral expressions. Neutral expressions were used as the starting point to create morphing animations and to create a mosaic image. None of these faces was familiar to any of the participants. For the purpose of minimizing extraneous clues (e.g., hair), the faces were oval. The visual angles of the prime facial expression stimuli were 7.0∘ vertical × 5.0∘ horizontal.

Dynamic facial expressions were created from the photos using a morphing technique (Figure ). First, based on neutral (0%) and emotional (100%) expressions, facial expressions with intensities of 34 and 66% were created using morphing software (FUTON System, ATR) implemented on a computer operating with Linux. This software has been used in several other studies (e.g., Sato et al., 2004; Sato and Yoshikawa, 2007a). Next, to create a dynamic video clip, 34, 66, and 100% facial expressions were presented in succession. In Experiment 1 (2), each image was presented for 6.7 (10) ms, and thus each clip lasted for 20 (30) ms.

Photographs of emotional facial expressions (100%) were presented as static expressions for 20 and 30 ms in Experiments 1 and 2, respectively. A mosaic image was created from a neutral facial expression by dividing the photos into a 50 × 40 grid and randomly reordering the pieces, rendering the resulting photograph unrecognizable as a face.

The target neutral ideographic stimuli were 40 Korean characters. These stimuli were shown to be emotionally neutral and used in a subliminal affective priming experiment in a previous study (Sato and Aoki, 2006). The visual angle of the target stimuli was 5.0∘ vertical × 5.0∘ horizontal.

APPARATUS

Stimulus presentation was controlled by Presentation 14.9 (Neurobehavioral Systems) implemented on a Windows computer (HP Z200 SFF, Hewlett-Packard Company). The stimuli were presented on a 19-inch CRT monitor (HM903D-A, Iiyama) with refresh rates of 150 Hz (Experiment 1) and 100 Hz (Experiment 2) and a resolution of 1024 × 768 pixels. The refresh rate was confirmed by a high-speed camera (EXILIM FH100, Casio) with a temporal resolution of 1000 frames/s.

PROCEDURE

The experiments were conducted individually. Participants were seated 0.57 m from the monitor. An emotional evaluation session preceded a forced-choice recognition session. After the forced-choice recognition session, participants were debriefed and asked whether they had consciously perceived the primes in the emotional evaluation session.

Emotional evaluation

A total of 80 trials (10 trials with 10 individuals’ faces under each of eight experimental conditions: 2 presentation conditions × 2 emotions × 2 visual fields) involving preference judgments were performed. The targets were randomly assigned to the experimental conditions and presented twice during the experiment. All trials were conducted in a pseudorandomized order. Participants initially participated in a block of 10 practice trials to become familiar with the procedure.

In each trial (Figure ), a cross was initially presented for 1000 ms as a fixation point at the center of the visual field. A prime stimulus was then presented for 20 ms (Experiment 1) or 30 ms (Experiment 2) in either the left or the right visual field (the inside edge was 9.5∘ peripheral to the center); this was immediately followed by the presentation of a mask stimulus in the same place for 300 ms. The exposure duration of the prime and mask stimuli and the stimulus onset asynchrony (SOA) between them were determined based on data from previous subliminal studies (Esteves and Ohman, 1993) and the results of our preliminary studies. Then, the target ideograph was immediately presented at the same location for 1000 ms. Finally, the rating display was presented until the participant finished responding.

The participants were asked to gaze throughout the experiment at the location at which the fixation point had been presented. The participants’ task was to rate their preferences for the target ideographs using a five-point scale from “not at all” to “very much.” They were asked to respond by pressing keys with their right index finger.

Forced-choice recognition

As an objective approach to measuring the subliminal effect of the prime stimuli, the forced-choice recognition session was held after the preference sessions, as in previous studies (Murphy and Zajonc, 1993; Sato and Aoki, 2006). We randomly selected half of the stimuli under each experimental condition to reduce the number of trials, and a total of 40 trials (five trials under each of eight experimental conditions) were conducted.

In each trial, the sequence of events was presented in the same manner as in the preference session. Then, the two photos of emotional facial expressions, one of which had been presented as the prime in the previous trial, were presented in the upper and lower visual fields. The emotion of the two facial stimuli was identical (i.e., fear or happiness), and the participants judged which face had been presented before. This task was based on the assumption that participants who had acquired a visual awareness of faces would be able to select these faces based on low-level visual information. We did not use the facial expressions depicting different emotions because a previous study showed that a patient with blindsight had discriminated among facial expressions depicting different emotions in the absence of a conscious awareness of the faces (de Gelder et al., 1999), suggesting that people can discriminate among faces displaying different emotions based on unconsciously processed emotional information.

DATA ANALYSIS

Data were analyzed using SPSS 16.0J software (SPSS Japan). The preference rating data were analyzed with three-way repeated-measures analyses of variance (ANOVAs) with presentation condition, emotion, and visual field as within-participant factors. Simple-effect analyses were performed as follow-up analyses (Kirk, 1994).

Our analysis of the forced-choice recognition data used one-sample t-tests to calculate the percentage of correct recognition responses. We then conducted paired t-tests comparing dynamic with static presentation conditions.

RESULTS

PREFERENCE EVALUATION

In terms of the preference ratings in Experiment 1 (Table ; Figure ), the ANOVA with presentation condition, emotion, and visual field as factors revealed a significant interaction between presentation condition and emotion [F(1,22) = 5.54, p < 0.05], indicating that the subliminal emotional effects differed across presentation conditions. Additionally, the main effect of emotion and the interaction between presentation condition and visual field were marginally significant [F(1,22) = 3.47, p < 0.1; F(1,22) = 3.21, p < 0.1]. We found no other significant main effects or interactions (p > 0.1).

Mean ratings (with SE) for emotional evaluation in Experiments 1 (left) and 2 (right).

To clarify the subliminal emotional effect under each presentation condition, the simple main effects of emotion were analyzed to examine the interaction between presentation condition and emotion. The results revealed a significant simple main effect of emotion under the dynamic presentation condition [F(1,44) = 8.67, p < 0.01], indicating that subliminal dynamic presentations of fearful, compared with happy, facial expressions were associated with lower preference ratings for subsequent targets. This effect was not significant under the static presentation condition [F(1,44) = 0.01, p > 0.1].

Similar patterns were observed for the preference ratings in Experiment 2 (Table ; Figure ). The three-way ANOVA revealed that the interaction between presentation condition and emotion was significant [F(1,21) = 4.71, p < 0.05], indicating different subliminal emotional effects across presentation conditions. Additionally, the interaction between presentation condition and visual field was marginally significant [F(1,21) = 3.54, p < 0.1]. We found no other significant main effects or interactions (p > 0.1).

Follow-up simple-effect analyses were performed for the presentation condition × emotion interaction to test the subliminal emotional effect under each presentation condition. The simple main effect of emotion was significant under the dynamic presentation condition [F(1,42) = 4.76, p < 0.01] but not under the static presentation condition [F(1,42) = 0.63, p > 0.1], indicating that subliminally presented dynamic, but not static, fearful versus happy facial expressions reduced the preference for targets.

FORCED-CHOICE RECOGNITION

The mean (±SE) percentage of correct recognition responses was 50.1% (±2.7) in Experiment 1 and 49.3% (±2.5) in Experiment 2. One-sample t-tests were performed to identify differences that exceeded the level of chance, and the results showed that the percentage of correct recognitions did not significantly differ from chance in either experiment (t < 0.84, p > 0.1). These results serve as the objective criterion that the primes had been presented subliminally under the present experimental conditions (Eriksen, 1960). We also tested for differences between dynamic and static presentation conditions and found no significant differences (paired t-test, t < 1.53, p > 0.1). The debriefing interview further confirmed that none of the participants had subjectively perceived the primes.

DISCUSSION

Our data showed that dynamic presentations of facial expressions induced more evident subliminal emotional effects than did static presentations. These results are consistent with several behavioral studies showing the facilitative effect of various types of behavioral responses (e.g., Sato and Yoshikawa, 2007a). However, these previous studies investigated only the effect of the supraliminal presentation of dynamic facial expressions. To our knowledge, this is the first evidence demonstrating the facilitative effect of dynamic facial expressions on unconscious emotional processing.

We found no clear subliminal effects of emotional facial expressions under the static condition. This result is consistent with several previous studies reporting the null effects of subliminally presented static facial expressions (e.g., Paul et al., 2012), although other studies reported a significant effect in this regard (e.g., Murphy and Zajonc, 1993). This discrepancy may be attributable to methodological differences. In this study, we strictly controlled the presentation of subliminal stimuli by using carefully selected masking stimuli, software, and hardware; the success of this approach was confirmed with subjective and objective measures. These presentation conditions may not have been sufficient to activate the neurological mechanism underlying the subliminal emotional effects of static stimuli. However, our results indicate that dynamic presentations of expressions were able to elicit subliminal effects even though an excessively rapid presentation style may have precluded observation of the subliminal effects of static stimuli.

Our data showing an enhanced effect of subliminal presentations of dynamic versus static facial expressions have theoretical and practical implications for future research on unconscious emotional processing. Theoretically, our data suggest that unconscious emotional processing has a stronger impact on daily social interactions involving dynamic facial expressions than researchers have previously assumed based on data obtained using static presentations. It has been shown that unconscious emotional processing can modify various types of decisions and behaviors (Ferguson and Bargh, 2004), and actual social interactions involving dynamic facial expressions probably generate marked unconscious biases that impact decisions and behaviors.

Practically, our data suggest that researchers should use dynamic presentations to elicit more pronounced effect of subliminally presented emotional facial expressions. This technique would be helpful for detecting subtle effects, such as differences between normal and clinical groups. For example, a previous study tested the effect of subliminal affective priming in individuals with autism spectrum disorders and typically developing controls using static facial expressions (Kamio et al., 2006). Although the researchers found group differences, the results for typically developing controls did not clearly show the predicted pattern of affective priming. We speculate that dynamic presentations may facilitate the induction of a more robust effect of subliminal facial expressions. It would also be interesting to apply this technique to realistic situations. Several previous studies tested the effect of subliminal presentations of emotional pictures in realistic situations and reported null findings (e.g., Underwood, 1994). Based on such data, some researchers proposed that subliminal methods are not effective in realistic situations (e.g., Moore, 1992). Our results suggest that the more powerful effect of dynamic, compared with static, subliminal presentations of facial expressions may have the potential to modify decisions and behaviors in realistic situations.

Our data also offer clues about the neural mechanisms underlying the processing of subliminal facial expressions, suggesting that the unconscious processing of emotional facial expressions is implemented by a neural substrate sensitive to dynamic visual information. This finding fits well with the model based on neuroimaging data showing that the unconscious processing of emotional facial expressions may be implemented by subcortical visual input into the amygdala (Morris et al., 1999). Consistent with this model, one neuroimaging study has shown that amygdala activation was related to the emotional impact of subliminally presented facial expressions (Suslow et al., 2013), and an intracranial electroencephalographic recording study revealed that the amygdala was more active about 100 ms following stimulus onset in response to emotional than to neutral facial expressions (Sato et al., 2011). Anatomical studies in animals (Day-Brown et al., 2010) and humans (Tamietto et al., 2012) have shown that the amygdala receives visual input via subcortical pathways involving the pulvinar and superior colliculus, bypassing the cortical visual areas. With respect to the effect of visual motion information on these neural mechanisms, a neuroimaging study in humans (Schneider and Kastner, 2005) and ample evidence in animals (for reviews, see Stein, 1988; Waleszczyk et al., 2004) suggested that the superior colliculus was more sensitive to dynamic compared with static visual information. Several neuroimaging studies have also found that the amygdala was more active in response to dynamic versus static facial expressions (e.g., LaBar et al., 2003). Together with these data, our findings indicate that one of the important behavioral functions of amygdala activation by the subcortical visual pathway involves unconscious emotional processing in response to dynamic facial expressions.

Several limitations of the present study should be acknowledged. First, because we presented different event sequences after the presentation of facial expressions and varying masks across preference evaluations and forced-choice recognition tasks, the conscious awareness of faces observed in the former task may not have been reflected in the performance of the latter task. It is possible that differences in subsequent displays served as different backward masking conditions and produced different levels of conscious awareness. Changes in subsequent events may have also altered cognitive strategies, which may then have produced different levels of conscious awareness. Attempts to replicate the subliminal emotional effects observed for dynamic facial expressions using different threshold confirmation tasks (e.g., using the same event sequences with preference ratings but asking participants to label the emotions depicted by facial expressions) are needed to resolve this problem.

Second, we presented the faces of the same individuals repeatedly (although the number of trials was equal across experimental conditions), which may have influenced the preferential ratings. Several previous studies have reported that repeated subliminal presentations of stimuli increased the preference for those stimuli (e.g., Kunst-Wilson and Zajonc, 1980). Such data suggest that the overall ratings may have been inflated by the procedure used in the present study. Future research that manipulates the number of repetitions may be useful for examining this possibility.

Finally, we tested the effect of only dynamic presentations of emotional facial expressions because ample evidence has indicated that facial expressions can be processed unconsciously. Interestingly, some recent behavioral studies have shown that eye gaze was also processed without conscious awareness (Sato et al., 2007; Al-Janabi and Finkbeiner, 2012). Neuroscientific research suggested that the amygdala is related to the processing of eyes (Okada et al., 2008; Sato et al., 2009), as in the case of facial expressions. Another line of research has suggested that processing of emotional scenes can also be accomplished unconsciously and is related to the amygdala (Kubota et al., 2000; Gläscher and Adolphs, 2003). These data suggest the possibility that dynamic presentations may facilitate unconscious processing of these stimuli, which would be an important matter for future research.

In summary, our results showed that dynamic presentations of emotional facial expressions induced more evident emotional biases in evaluations of subsequent targets than did static ones. These results indicate that dynamic presentation of emotional facial expressions enhances unconscious emotional processing.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Table 1

Mean ratings (with SE) for emotional evaluation in Experiment 1 (upper) and 2 (lower).

Experiment	Dynamic				Static
	LVF		RVF		LVF		RVF
	Fear	Happiness	Fear	Happiness	Fear	Happiness	Fear	Happiness
1	2.87 (0.09)	3.07 (0.09)	2.80 (0.11)	3.04 (0.09)	2.88 (0.08)	2.87 (0.07)	3.07 (0.08)	3.06 (0.10)
2	3.03 (0.08)	3.17 (0.09)	2.80 (0.10)	3.05 (0.10)	2.91 (0.12)	2.92 (0.12)	3.04 (0.10)	2.96 (0.13)