Wetzel, Frick, & Brown (2020)_Does multidimensional forced-choice prevent faking?

Abstract

<p>A common concern with self-reports of personality traits in selection contexts is faking. The multidimensional forced-choice (MFC) format has been proposed as an alternative to rating scales (RS) that could prevent faking. The goal of this study was to compare the susceptibility of the MFC and RS format to faking in a simulated high-stakes setting. Participants were randomly assigned to three groups (total N = 1,867) and filled out the Big Five Triplets once under an honest instruction and once under a fake-good instruction. Latent mean differences between the honest and fake-good administrations indicated that the Big Five domains were faked in the expected direction. Faking effects for all traits were larger for RS compared to MFC. Faking effects were also larger for the MFC version with mixed triplets compared to the MFC version with triplets that were fully matched regarding their social desirability. The MFC format does not prevent faking completely, but it reduces faking substantially. Faking can be further reduced in the MFC format by matching the items presented in a block regarding their social desirability.</p>

The Multidimensional Forced-Choice Format as an Alternative for Rating Scales

“…Cao and Drasgow (2019) also checked scoring method (ipsative, partially ipsative, normative) as a moderator and found significant faking effects only with ipsative and partially ipsative scoring, but not normative scoring of MFC data. Wetzel et al (2020) confirmed previous findings with a Thurstonian item response model analysis of MFC data and additionally showed that the degree to which MFC can be faked depends on how well the items within blocks are matched in terms of their desirability.…”

“…MFC eliminates response styles in self-report questionnaires (e.g., acquiescence) and rater biases (e.g., severity/leniency), whereas these biases occur when questionnaires are administered with RS. MFC is harder to fake than RS, especially when items within blocks have been matched carefully with respect to their desirability (Wetzel et al, 2020).…”

Taking the Test Taker’s Perspective: Response Process and Test Motivation in Multidimensional Forced-Choice Versus Rating Scale Instruments

“…We applied the Big Five Triplets (Wetzel & Frick, 2017), which assess the Big Five personality traits neuroticism, extraversion, openness to experience, agreeableness, and conscientiousness. The original response format is an MFC format with 20 triplets (i.e., 60 items in total).…”

The World Beyond Rating Scales

“…Example for the rating scale response format with items from the Big Five Triplets (Wetzel & Frick, 2017). …”