Research into Emotion Decoding Accuracy (EDA) has revealed limited associations with personality. One possible reason could be the neglect of social context influences on the perception of emotions, which is problematic given the interplay of personality with social context. We propose a novel way to understand accuracy in emotion perception, which includes social context and the distinction between accuracy (perceiving the intended emotions) and inaccuracy (perceiving additional emotions to those expressed). In seven studies that utilized three methods, we found that personality traits that tap the social domain, consistently relate, in a meaningful way, to accuracy and inaccuracy in emotion perception. Accuracy and inaccuracy capture different aspects of the variance and do so more than traditional, hit rate based, methods and tests for assessing the accurate decoding of facial emotion expressions.