Cultural differences in emotion perception have been reported mainly for facial expressions and to a lesser extent for vocal expressions. However, the way in which the perceiver combines auditory and visual cues may itself be subject to cultural variability. Our study investigated cultural differences between Japanese and Dutch participants in the multisensory perception of emotion. A face and a voice, expressing either congruent or incongruent emotions, were presented on each trial. Participants were instructed to judge the emotion expressed in one of the two sources. The effect of to-be-ignored voice information on facial judgments was larger in Japanese than in Dutch participants, whereas the effect of to-be-ignored face information on vocal judgments was smaller in Japanese than in Dutch participants. This result indicates that Japanese people are more attuned than Dutch people to vocal processing in the multisensory perception of emotion. Our findings provide the first evidence that multisensory integration of affective information is modulated by perceivers' cultural background.

No abstract

No abstract

Anxious individuals have been shown to interpret others' emotional states negatively. Since most studies have used facial expressions as emotional cues, we examined whether trait anxiety affects the recognition of emotion in a dynamic face and voice that were presented in synchrony. The face and voice cues conveyed either matched (e.g., happy face and voice) or mismatched emotions (e.g., happy face and angry voice). Participants with high or low trait anxiety were to indicate the perceived emotion using one of the cues while ignoring the other. The results showed that individuals with high trait anxiety were more likely to interpret others' emotions in a negative manner, putting more weight on the to-be-ignored angry cues. This interpretation bias was found regardless of the cue modality (i.e., face or voice). Since trait anxiety did not affect recognition of the face or voice cues presented in isolation, this interpretation bias appears to reflect an altered integration of the face and voice cues among anxious individuals.

The subliminal mere exposure effect (SMEE) is the phenomenon wherein people tend to prefer patterns they have repeatedly observed without consciously identifying them. One popular explanation for the SMEE is that perceptual fluency within exposed patterns is misattributed to a feeling of preference for those patterns. Assuming that perceptual fluency is negatively correlated with the amount of mental effort needed to analyze perceptual aspects of incoming stimuli, pupil diameter should associate with SMEE strength since the former is known to reflect mental effort. To examine this hypothesis, we measured participants’ pupil diameter during exposure to subthreshold stimuli. Following exposure, a preference test was administered. Average pupil diameter throughout exposure was smaller when the SMEE was induced than when the SMEE was not induced. This supports the hypothesis that increasing perceptual fluency during mere exposure modulates autonomic nervous responses, such as pupil diameter, and eventually leads to preference.