Development of the Paranormal and Supernatural Beliefs Scale using classical and modern test theory

Abstract

Background This study describes the construction and validation of a new scale for measuring belief in paranormal phenomena. The work aims to address psychometric and conceptual shortcomings associated with existing measures of paranormal belief. The study also compares the use of classic test theory and modern test theory as methods for scale development. Method We combined novel items and amended items taken from existing scales, to produce an initial corpus of 29 items. Two hundred and thirty-one adult participants rated their level of agreement with each item using a seven-point Likert scale. Results Classical test theory methods (including exploratory factor analysis and principal components analysis) reduced the scale to 14 items and one overarching factor: Supernatural Beliefs. The factor demonstrated high internal reliability, with an excellent test–retest reliability for the total scale. Modern test theory methods (Rasch analysis using a rating scale model) reduced the scale to 13 items with a four-point response format. The Rasch scale was found to be most effective at differentiating between individuals with moderate-high levels of paranormal beliefs, and differential item functioning analysis indicated that the Rasch scale represents a valid measure of belief in paranormal phenomena. Conclusions The scale developed using modern test theory is identified as the final scale as this model allowed for in-depth analyses and refinement of the scale that was not possible using classical test theory. Results support the psychometric reliability of this new scale for assessing belief in paranormal phenomena, particularly when differentiating between individuals with higher levels of belief.

Variations in Well-Being as a Function of Paranormal Belief and Psychopathological Symptoms: A Latent Profile Analysis

“…The notion that paranormal belief can in some circumstances provide a sense of control implies that credence performs an adaptive function (Schumaker, 1987;Dean et al, 2021;Parra and Giudici, 2022). This, however, this is not necessarily the case since psychological benefits are typically restricted to specific situations (Roe and Bell, 2016).…”

Paranormal beliefs and cognitive function: A systematic review and assessment of study quality across four decades of research

“…Second, gender (and age) effects are not consistently reported [ 33 ] and have resulted in substantial debate [ 34 – 36 ]. This debate largely results from differences in psychological test theories (see Dean et al 2021 [ 83 ] for a discussion). Classical test theory—used to develop common paranormal belief measures, such as the RPBS—does not test for the presence of differential item functioning (DIF).…”

Belief in Jinn Possession Scale: Development and validation

“…Because prior measures evaluating paranormal beliefs were criticized for lacking negatively worded items, this study intended to deal with this problem by constructing a scale that merges both positively and negatively phrased items (Dean et al, 2021). These four factors represent believers of jinn possession ranging from informed believers (whose views reflect a profound knowledge of paranormal events) to quasi-believers (whose opinions reflect a naive grasp of paranormal occurrences) (see Dean et al, 2021). In addition, this scale also considers the emotional and behavioral dimensions of beliefs in addition to the cognitive ones (see Marks, 2021).…”

“…Paranormal and Supernatural Belief Scale. The PSBS (Dean et al, 2021) has 13 items with a 4-point Likert-type scale. Items 7, 8, and 12 were reverse-coded.…”