Equivalence of unproctored internet testing and proctored paper‐and‐pencil testing of the Big Five

Abstract

The use of unproctored Internet‐based testing (IBT) for personality assessment is increasingly popular, especially in personnel selection. Previous studies on its equivalence to traditional proctored paper‐and‐pencil testing (PPT) have used between‐subjects designs, which makes it difficult to separate intergroup effects from format effects, and have shown mixed results. The aim of the present study was to assess the quantitative, qualitative, and auxiliary equivalence of unproctored IBT and proctored PPT of personality, using a within‐sample design. Undergraduate students (n = 407) completed both an Internet and a paper‐and‐pencil version of a measure of the Big Five, with a 1 to 3 week interval. The proctored paper‐and‐pencil assessment was completed in class and the unproctored Internet assessment was completed at the time and place chosen by the participants. Results showed effect sizes for mean differences to vary from null to small. Skewness and kurtosis indices, reliability coefficients, intercorrelations magnitudes, as well as factor solutions, were highly similar across formats. Respondents did not prefer IBT over PPT on a series of statement about their perceptions and reactions to IBT. In conclusion, results suggest that IBT and PPT of the Big Five personality traits are equivalent, and that the data obtained are comparable across formats.

Intelligence and Personality

“…In contrast, the present study found that all Big Five dimensions and their aspects were significantly correlated with g as well as with verbal and nonverbal intelligence. One possible explanation comes from the fact that correlations between personality scales in our sample were high ( Mdn r = .50), and significantly higher than previously reported for the LCPI in a sample of university students ( Mdn r = .23; Le Corff, Gingras, & Busque-Carrier, 2017). High stakes assessment settings such as personnel selection are known to produce more desirable personality profiles, that is, higher scores on Openness to Experience, Conscientiousness, Extraversion, Agreeableness, and Emotional Stability (Birkeland, Manson, Kisamore, Brannick, & Smith, 2006).…”

“…In contrast, the present study found that all Big Five dimensions and their aspects were significantly correlated with g as well as with verbal and nonverbal intelligence. One possible explanation comes from the fact that correlations between personality scales in our sample were high (Mdn r = .50), and significantly higher than previously reported for the LCPI in a sample of university students (Mdn r = .23; Le Corff, Gingras, & Busque-Carrier, 2017).…”

Validity of an Inconsistency Scale for the PID-5 in Community-Dwelling Younger and Older Adults

“…These differences in data collection may impact results. However, studies suggest that paper-and-pencil and internet data collection are generally equivalent, and obtained data are comparable across formats (Le Corff et al., 2017; Weigold et al, 2013). We used computer-generated random responses and not simulations done by real participants (e.g., Dhillon et al, 2017).…”

Students' Perspective Towards Online Proctoring in Exams During Covid-19

“…Students have a positive attitude towards online proctoring when it does not affect their academic performance (Davis et al, 2016;Hollister & Berenson, 2009;Weiner & Hurtz, 2017). Le Corff and others reported when comparing five personality traits with an un-proctored online test and proctored paper test, the acceptance for both the method is equivalent (Le Corff et al, 2017). However, academic integrity should be maintained in both testing methods (Chuang et al, 2015;Medina & Castleberry, 2016).…”