Addressing traceability of self-reported dependence measurement through the use of crosswalks

Salzberger, Thomas; Cano, Stefan; Abetz-Webb, Linda; Afolalu, Esther F.; Chrea, Christelle; Weitkunat, Rolf; Rose, Jed E.

doi:10.1016/j.measurement.2021.109593

Cited by 9 publications

(7 citation statements)

References 54 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The Rasch model, applied in this study, offers a logical progression from the CTT paradigm to a more sophisticated model [ 48 ], namely, a specific metrological approach to human-based measurements [ 41 ], to overcome the shortages with ordinality and lack of separation between item and person attributes. A key factor for comparability, independent of which items are included, is traceability to metrological references, which is enabled with calibrated items [ 41 , 49 , 50 ]. Thus, applying the Rasch model ensures improved possibilities for metrological comparability.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Self-Efficacy to Manage Chronic Disease (SEMCD) scale: translation and evaluation of measurement properties for a swedish version

et al. 2023

View full text Add to dashboard Cite

Background Reinforcing self-efficacy in patients is important in person-centered care; therefore, reliable and valid measures of a person’s self-efficacy is of clinical relevance. A questionnaire suitable for self-efficacy and patient engagement that is not limited to a particular condition is the Self-efficacy to Manage Chronic Disease (SEMCD). This study aims to evaluate the measurement properties of a Swedish translation of the SEMCD with a Rasch analysis. Methods The translation and cultural adaptation of the SEMCD was performed according to the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) recommendations. Self-reported data was collected from two cohorts: patients with pituitary tumors (n = 86) and patients on sick leave due to common mental disorders (n = 209). Measurement properties were evaluated with a Rasch analysis in RUMM2030. Results The original six-item SEMCD did not fit to a unidimensional scale. Two items, item 5 and item 6, deviated both statistically and conceptually and were removed. A four-item solution, the SEMCD-4 with collapsed thresholds for mid-range response options, showed good targeting and unidimensionality, no item misfit, and a reliability of 0.83. Conclusion In a Swedish context with a mix of patients with pituitary tumors or common mental disorders, SEMCD-4 showed satisfactory measurement properties. Thus, SEMCD-4 could be used to identify patient self-efficacy in long-term illnesses. This knowledge about patient self-efficacy may be of importance to tailor person-centered support based on each patient´s resources, needs and goals.

show abstract

Section: Discussionmentioning

confidence: 99%

“…Thus, applying the Rasch model ensures improved possibilities for metrological comparability. Specifically, sets of items (e.g., SEMCD and SEMCD-4) can be linked to a common self-efficacy measures by means of co-calibration of item parameters [ 50 ].…”

Section: Discussionmentioning

confidence: 99%

Self-Efficacy to Manage Chronic Disease (SEMCD) scale: translation and evaluation of measurement properties for a swedish version

et al. 2023

View full text Add to dashboard Cite

show abstract

“…Figure 1 shows the process from raw data, via the Rasch analysis, to crosswalk tables with score-to measure conversions. In line with the Salzberger et al 8 methodology, crosswalks were enabled via item anchors from the NMM into separate analyses of the legacy memory tests. Score-to-measure conversions were retrieved for the NMM of 57 items and the individual legacy memory tests.…”

Section: Discussionmentioning

confidence: 99%

“…However, assessing or reporting measurement uncertainty has little tradition in human-based measurements. Within the Rasch model, the standard error of measurement (i.e., the reciprocal proportion to the square root of the amount of information) is an estimate of the random error and is typically used to reflect measurement uncertainties, while considerations of what extent systematic errors contribute to measurement uncertainty have not, as yet, been made 8,50,51 . Thus, the Rasch model provides opportunities to better align measurement uncertainty in psychometric studies with that used in physical metrology 8 .…”

Section: Discussionmentioning

confidence: 99%

Traceability and comparability through crosswalks with the NeuroMET Memory Metric

Melin

Cano²,

Gillman³

et al. 2023

Sci Rep

View full text Add to dashboard Cite

Accurate assessment of memory ability for persons on the continuum of Alzheimer’s disease (AD) is vital for early diagnosis, monitoring of disease progression and evaluation of new therapies. However, currently available neuropsychological tests suffer from a lack of standardization and metrological quality assurance. Improved metrics of memory can be created by carefully combining selected items from legacy short-term memory tests, whilst at the same time retaining validity, and reducing patient burden. In psychometrics, this is known as “crosswalks” to link items empirically. The aim of this paper is to link items from different types of memory tests. Memory test data were collected from the European EMPIR NeuroMET and the SmartAge studies recruited at Charité Hospital (Healthy controls n = 92; Subjective cognitive decline n = 160; Mild cognitive impairment n = 50; and AD n = 58; age range 55–87). A bank of items (n = 57) was developed based on legacy short-term memory items (i.e., Corsi Block Test, Digit Span Test, Rey’s Auditory Verbal Learning Test, Word Learning Lists from the CERAD test battery and Mini Mental State Examination; MMSE). The NeuroMET Memory Metric (NMM) is a composite metric that comprises 57 dichotomous items (right/wrong). We previously reported on a preliminary item bank to assess memory based on immediate recall, and have now demonstrated direct comparability of measurements generated from the different legacy tests. We created crosswalks between the NMM and the legacy tests and between the NMM and the full MMSE using Rasch analysis (RUMM2030) and produced two conversion tables. Measurement uncertainties for estimates of person memory ability with the NMM across the full span were smaller than all individual legacy tests, which demonstrates the added value of the NMM. Comparisons with one (MMSE) of the legacy tests showed however higher measurement uncertainties of the NMM for people with a very low memory ability (raw score ≤ 19). The conversion tables developed through crosswalks in this paper provide clinicians and researchers with a practical tool to: (i) compensate for ordinality in raw scores, (ii) ensure traceability to make reliable and valid comparisons when measuring person ability, and (iii) enable comparability between test results from different legacy tests.

show abstract

“…Making such documentation available as additional materials to a preprint would be beneficial for the peerreview process as well as post-publication discussions and for others to learn about psychometrics. Increased transparency in the analysis process can also be connected to traceability, which is a central concept in other areas of metrology, but seldom discussed in the context of psychometrics (Pendrill, 2014;Salzberger et al, 2021;Uher, 2018Uher, , 2020Uher, , 2022.…”

Section: Rasch Analysis Softwarementioning

confidence: 99%

Valid and Reliable? Basic and Expanded Recommendations for Psychometric Reporting and Quality Assessment.

Johansson¹,

Preuter²,

Karlsson³

et al. 2023

Preprint

View full text Add to dashboard Cite

There is a need to improve the validity, reliability, and replicability of social and health science research and its applications through raising the quality of measurement. An important step is to establish and implement a clear and useful standard for reporting and assessing psychometric properties of measures. We propose five basic criteria as a minimal checklist to help end users assess the quality of psychometric studies: unidimensionality; ordered response categories, invariance; targeting; and, contingent upon the previous four being fulfilled, reliability. An expanded and detailed reporting guideline is also presented, intended for use in reports and scientific publications of psychometric analyses. Additionally, we present a freely available R package to streamline psychometric analysis with Rasch Measurement Theory and its documentation in line with the reporting guideline.

show abstract

Addressing traceability of self-reported dependence measurement through the use of crosswalks

Cited by 9 publications

References 54 publications

Self-Efficacy to Manage Chronic Disease (SEMCD) scale: translation and evaluation of measurement properties for a swedish version

Self-Efficacy to Manage Chronic Disease (SEMCD) scale: translation and evaluation of measurement properties for a swedish version

Traceability and comparability through crosswalks with the NeuroMET Memory Metric

Valid and Reliable? Basic and Expanded Recommendations for Psychometric Reporting and Quality Assessment.

Contact Info

Product

Resources

About