An Instructional Module on Mokken Scale Analysis

Wind, Stefanie A.

doi:10.1111/emip.12153

Cited by 43 publications

(59 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The unidimensional nature of the scale is further supported by the high McDonald's omega hierarchal value [39,52], with the coefficient suggesting that 91% of the variance of the GLSS T-Score is due to the general factorlife satisfaction. The other MSA results support the GLSS as meeting the requirements of the Mokken scale [53]. The ability to order the GLSS items (invariant item ordering), that is, the order of the items consistently reflects an increasing level of life satisfaction, does not appear possible.…”

Section: Discussionmentioning

confidence: 73%

PROMIS® General Life Satisfaction scale: construct validity in musculoskeletal pain patients

2020

View full text Add to dashboard Cite

Background: Life satisfaction is part of subjective well-being. Measurement of life satisfaction is undertaken using self-report measures. This study aimed to evaluate the structural validity, concurrent validity, and internal structure of the PROMIS® General Life Satisfaction Scale (GLSS) in a musculoskeletal pain cohort. Method: Consecutive new patients attending the Victoria University Osteopathy Clinic (Melbourne, Australia) were invited to complete the GLSS prior to their initial consultation. Structural validity and internal structure were explored using confirmatory factor analysis and Mokken scale analysis. Concurrent validity was evaluated against a single-item measure of life satisfaction. Results: The PROMIS® GLSS comprised a single factor and formed an acceptable Mokken scale in this population. No differential item functioning was observed. A large positive correlation (r = 0.70) was observed between the General Life Satisfaction scale and a single-item measure of life satisfaction. Conclusions: The PROMIS® General Life Satisfaction scale demonstrated acceptable internal structure and structural validity in a musculoskeletal pain population. Additional research is required to explore concurrent validity and other measurement properties, however initial data suggests the measure could be a feasible screen of life satisfaction for Australian osteopathic patients.

show abstract

Section: Discussionmentioning

confidence: 73%

PROMIS® General Life Satisfaction scale: construct validity in musculoskeletal pain patients

2020

View full text Add to dashboard Cite

show abstract

“…Descriptive statistics were generated for items and subscales. Construct validity of the MTQ involved (1) data examination, (2) scaling as recommended by Sijtsma and van der Ark (2017) and (Wind 2017) and (3) predictive validity (Crișan et al 2020). For the student engagement measure, Principal Component Analysis (PCA) (varimax rotation) and Confirmatory Factor Analysis (CFA) were performed with the ML estimator for both models using the R package 'lavaan'.…”

Section: Discussionmentioning

confidence: 99%

“…Additionally, the availability of frequently-updated software R with graphical features and the package Mokken (van der Ark. 2007, 2012 supports the popularity of MS among educational researchers (Wind 2017(Wind , 2019. MS uses two NIRT models: the Monotone Homogeneity Model (MHM) based on three assumptions (monotonicity, unidimensionality and local independence); and a general and more strict Double Monotonicity Model (DMM) obtained by adding a fourth assumption, namely, evidence of Invariant Rater Ordering (IRO).…”

Section: Mokken Scaling (Ms)mentioning

confidence: 99%

Students’ perceptions of teaching behaviour in Turkish secondary education: a Mokken Scaling of My Teacher Questionnaire

Telli

Maulana

Helms-Lorenz

2020

Learning Environ Res

View full text Add to dashboard Cite

Teacher behaviour has significant impact on student learning and outcomes and determines the teaching quality in learning environments. The My Teacher Questionnaire (MTQ) has been used to assess students' perceptions of teaching behaviour in national and international studies with well-cited outcomes. In this cross-sectional survey study, we adjusted and shortened the MTQ for diverse settings in Turkish secondary education, using the nonparametric IRT model, Mokken Scaling (MS). The sample consisted of 12,036 students (grade 9-12, age 15-19 years) involving 446 classes/teachers from 24 general public high schools in Turkey. More than half of the students (n = 6544, 54.40%) were females, while 306 students (2.5%) did not report their gender. The MS polytomous Double Monotonicity Model (DMM) was employed for scaling the individual student data. The ten selected items (MTQ10) showed a strong unidimensional structure (H = 0.61) with good internal reliability (Cronbach's α = 0.93, Molenaar Sijtsma ρ = 0.93) and construct validity. The final structure was tested on three random data sets and convergent validity of the MTQ10 was examined using student engagement in learning. The scale MTQ10 functioned well across various groups (random samples, genders, grades, subjects). Based on these results, MTQ10 reveals strong psychometric quality for the assessment of students' perceptions of teaching behaviour with the potential to deepen our understanding of teaching behaviours and teaching quality in Turkey.

show abstract

“…In this study, the existing literature on the practical use of MSA (see Sijtsma & van der Ark, 2017 and Wind, 2017 for excellent tutorials for practitioners in the fields of psychology and education) is extended by systematically investigating how practical outcomes, such as scale reliability and person rank ordering, were affected by scores obtained from scales containing items with low scalability coefficients. This study also extends previous literature on the practical significance ( Sinharay & Haberman, 2014 ) of the misfit of IRT models (e.g., Crişan et al, 2017 ) by focusing on nonparametric IRT models.…”

Section: Practical Significancementioning

confidence: 99%

On the Practical Consequences of Misfit in Mokken Scaling

Crisan

Tendeiro

Meijer

2020

Applied Psychological Measurement

View full text Add to dashboard Cite

Mokken scale analysis is a popular method to evaluate the psychometric quality of clinical and personality questionnaires and their individual items. Although many empirical papers report on the extent to which sets of items form Mokken scales, there is less attention for the effect of violations of commonly used rules of thumb. In this study, the authors investigated the practical consequences of retaining or removing items with psychometric properties that do not comply with these rules of thumb. Using simulated data, they concluded that items with low scalability had some influence on the reliability of test scores, person ordering and selection, and criterion-related validity estimates. Removing the misfitting items from the scale had, in general, a small effect on the outcomes. Although important outcome variables were fairly robust against scale violations in some conditions, authors conclude that researchers should not rely exclusively on algorithms allowing automatic selection of items. In particular, content validity must be taken into account to build sensible psychometric instruments.

show abstract

An Instructional Module on Mokken Scale Analysis

Cited by 43 publications

References 36 publications

PROMIS® General Life Satisfaction scale: construct validity in musculoskeletal pain patients

PROMIS® General Life Satisfaction scale: construct validity in musculoskeletal pain patients

Students’ perceptions of teaching behaviour in Turkish secondary education: a Mokken Scaling of My Teacher Questionnaire

On the Practical Consequences of Misfit in Mokken Scaling

Contact Info

Product

Resources

About