Reporting Guideline for RULER: Rasch Reporting Guideline for Rehabilitation Research: Explanation and Elaboration

et al. 2022

Preprint

Self Cite

Purpose The Multidimensional Assessment of Interoceptive Awareness (MAIA) measures interoceptive body awareness, which includes aspects such as attention regulation, self-regulation, and body listening. Our purpose was to validate the MAIA in adults with stroke using Rasch Measurement Theory. Methods The original MAIA has 32 items grouped into eight separately scored subscales that measure aspects of body awareness. Using Rasch Measurement Theory, we evaluated the unidimensionality of the entire scale and investigated person and item fit, person separation reliability, targeting, local item dependence, and principal components analysis of residuals. Results Forty-one adults with chronic stroke (average 3.8 years post-stroke, 13 women, and average age, 57+/-13 years) participated in the study. Overall fit (X2=62.26, p=0.26) and item fit were obtained after deleting 3 items and rescoring 26 items. One participant did not fit the model (2.44%). There were no floor (0.00%) or ceiling effects (0.00%). Local item dependence was found in 42 pairs. The person separation reliability was 0.91, and the person mean location was 0.06+/-1.12 logits. Conclusions The MAIA demonstrated good targeting and reliability, as well as good item and person fit in adults with chronic stroke. A study with a larger sample size is needed to validate our findings.

Section: Discussionmentioning

confidence: 99%

Preliminary Rasch analysis of the Multidimensional Assessment of Interoceptive Awareness in adults with stroke

et al. 2022

Preprint

Self Cite

“…Following the recently accepted guidelines for reporting Rasch analyses, we report on structural validity and unidimensionality with overall fit, item and person fit, examining the presence of reversed thresholds, person separation reliability (PSR), differential item functioning (DIF), principal components analysis of residuals (PCAR), targeting, floor, and ceiling effect. [11, 12] Unidimensionality refers to the fact that all items should measure one construct. Item-trait interaction measures the overall fit of the scale to the Rasch model using Chi-square statistics.…”

Section: Methodsmentioning

confidence: 99%

“…[6][7][8][9] The Rasch analysis ranks the item difficulty hierarchically from easy to difficult on the same logit scale as the person's ability. [10][11][12] It also transforms an ordinal scale to an interval scale providing more measurement precision. [10][11][12] The four studies that analyzed the WEMWBS with Rasch Measurement Theory obtained varied results in terms of targeting and number of items that remained after the Rasch analysis was completed.…”

Section: Introductionmentioning

confidence: 99%

“…[10][11][12] It also transforms an ordinal scale to an interval scale providing more measurement precision. [10][11][12] The four studies that analyzed the WEMWBS with Rasch Measurement Theory obtained varied results in terms of targeting and number of items that remained after the Rasch analysis was completed. [6][7][8][9] Of note, the data on the scale was acquired in different countries with possibly inherent differences in culture, which could at least partially explain this variation in results.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Rasch Validation of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS) in Community-Dwelling Adults and in Adults with Stroke in the US

et al. 2022

Preprint

Self Cite

Background: With the recent ongoing global COVID-19 pandemic and political divide in the United States (US), there is an urgent need to address the soaring mental well-being problems and to promote positive well-being. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS) measures the positive aspects of mental health. Previous studies confirmed its construct validity, reliability, and unidimensionality with confirmatory factor analysis. Four studies have performed a Rasch analysis on the WEMWBS, but none of them tested adults in the US. The goals of our study are to use Rasch analysis to validate the WEMWBS in the general US population and in adults with stroke. Methods: We recruited community-dwelling adults and adults with chronic stroke with upper limb hemiplegia or hemiparesis. We used the Rasch Unidimensional Measurement Model (RUMM) 2030 software to evaluate item and person fit, targeting, person separation reliability (PSR), and differential item functioning (DIF) for sample sizes of at least 200 persons in each subgroup. Results: After deleting two items, the WEMBS analyzed in our 553 community-dwelling adults (average age 51.22 +/- 17.18 years; 358 women) showed an excellent PSR=0.91 as well as person and item fit, but the items are too easy for this population (person mean location=2.17 +/- 2.00). There was no DIF for sex, mental health, or practicing breathing exercises. In the 37 adults with chronic stroke (average age 58 +/- 13; 11 women) the WEMWBS had a good item and person fit, and PSR=0.92, but the items were too easy for this group as well (person mean location=3.13 +/- 2.00). Conclusions: The WEMWBS had good item and person fit but the targeting is off when used in community-dwelling adults and adults with stroke in the US. Adding more difficult items might improve the targeting and capture a broader range of positive mental wellbeing in both populations. Our pilot data in adults with stroke needs to be confirmed in a larger sample size.

“…The structural validity of the BARQ-R was assessed with the Rasch Measurement Theory using the Rasch Unidimensional Measurement Model (RUMM2030) software and was reported following the Rasch Reporting Guideline for Rehabilitation Research (RULER). 19,20 The Rasch model is a probabilistic model, which states that a person with a higher ability on a certain construct would have a higher probability of obtaining a better score on the scale measuring that construct. 21…”

Section: Methodsmentioning

confidence: 99%

Rasch Validation of the Revised Body Awareness Rating Questionnaire (BARQ-R) in Adults with Musculoskeletal Pain, Adults with Spinal Cord Injury, and Community-Dwelling Adults in the US

et al. 2022

Preprint

Self Cite

BackgroundTo establish Rasch validation of the Revised Body Awareness Rating Questionnaire (BARQ-R) in adults with musculoskeletal pain, community-dwelling adults without pain, and adults with spinal cord injury (SCI) who have neuropathic pain.Materials and MethodThe BARQ-R has 12 items with scores ranging from 0 (completely disagree) to 3 (completely agree). Through Rasch analysis, we evaluated unidimensionality through item and person fit, targeting of the population, person separation reliability (PSR), local item dependence (LID), and principal components analysis of residuals (PCAR).ResultsThe BARQ-R in adults with musculoskeletal pain (n=152; average age = 52.26±16.13 years) showed good targeting (person mean location: -0.36±0.88 logits), minimal floor effect (0.01%), and no ceiling effect (0.00%) and had good reliability (PSR=0.75). The BARQ-R in community-dwelling adults (n=471; average age = 49.63±17.57 years) had a person mean location of -0.62±1.09 logits, minimal floor (2.63%), and minimal ceiling effect (0.43%) after rescoring 2 items and deleting 3 items and had good reliability (PSR=0.74). The BARQ-R in adults with SCI-related neuropathic pain (n=44; average age = 55.45±13.47 years) showed good targeting after rescoring 7 items (person mean location: -0.33±0.71 logits), no floor effect (0.00%) or ceiling effect (0.00%) but had poor reliability (PSR=0.65).ConclusionsThe BARQ-R shows sufficient fit to be used in clinical settings for group decision-making for both adults with musculoskeletal pain and community-dwelling adults. However, in adults with SCI-related neuropathic pain, preliminary Rasch analysis of the BARQ-R showed low reliability and therefore the BARQ-R is not recommended for clinical use in that population. Validation in larger groups of adults with SCI as well as more diverse samples are needed.