Work-related measures of physical and behavioral health function: Test-retest reliability

Marino, Molly; Meterko, Mark; Marfeo, Elizabeth; McDonough, Christine M.; Jette, Alan M.; Ni, Pengsheng; Bogusz, Kara; Rasch, Elizabeth K.; Brandt, D.; Chan, Leighton

doi:10.1016/j.dhjo.2015.04.001

Cited by 10 publications

(7 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Finally, to further inform application of the LBP-CS-SRC, the standard error of measurement (SEM) and minimum detectable change (MDC ) of the activity and participation scales were calculated using equations ( 1) and ( 2), 18 respectively.…”

Section: Discussionmentioning

confidence: 99%

Self-reported disability according to the International Classification of Functioning, Disability and Health Low Back Pain Core Set: Test-retest agreement and reliability

Bagraith

Strong

Meredith

et al. 2017

Disability and Health Journal

View full text Add to dashboard Cite

show abstract

Section: Discussionmentioning

confidence: 99%

Self-reported disability according to the International Classification of Functioning, Disability and Health Low Back Pain Core Set: Test-retest agreement and reliability

Bagraith

Strong

Meredith

et al. 2017

Disability and Health Journal

View full text Add to dashboard Cite

show abstract

“…This particular drawback of the maximum likelihood method can be found in the Work Disability Functional Assessment Battery (WD-FAB) which is a relatively recent application of IRT to the assessment of work-related physical and behavioral function intended to inform processes related to disability determination and other potential applications [9].…”

Section: Statistical Choices In Irt Model Constructionmentioning

confidence: 99%

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

et al. 2022

View full text Add to dashboard Cite

Item response theory (IRT) is the statistical paradigm underlying a dominant family of generative probabilistic models for test responses, used to quantify traits in individuals relative to target populations. The graded response model (GRM) is a particular IRT model that is used for ordered polytomous test responses. Both the development and the application of the GRM and other IRT models require statistical decisions. For formulating these models (calibration), one needs to decide on methodologies for item selection, inference, and regularization. For applying these models (test scoring), one needs to make similar decisions, often prioritizing computational tractability and/or interpretability. In many applications, such as in the Work Disability Functional Assessment Battery (WD-FAB), tractability implies approximating an individual’s score distribution using estimates of mean and variance, and obtaining that score conditional on only point estimates of the calibrated model. In this manuscript, we evaluate the calibration and scoring of models under this common use-case using Bayesian cross-validation. Applied to the WD-FAB responses collected for the National Institutes of Health, we assess the predictive power of implementations of the GRM based on their ability to yield, on validation sets of respondents, ability estimates that are most predictive of patterns of item responses. Our main finding indicates that regularized Bayesian calibration of the GRM outperforms the regularization-free empirical Bayesian procedure of marginal maximum likelihood. We also motivate the use of compactly supported priors in test scoring.

show abstract

“…This particular drawback of the maximum likelihood method can be found in the Work Disability Functional Assessment Battery (WD-FAB) which is a relatively recent application of IRT to the assessment of work-related function intended to inform processes related to disability determination among other potential applications [29].…”

Section: Statistical Choices In Irt Model Constructionmentioning

confidence: 99%

“…We focus on the concrete application of improving the statistical properties of the IRT model underlying the Work Disability Functional Assessment Battery (WD-FAB) [20,[26][27][28][29].…”

Section: Work Disability Functional Assessment Battery (Wd-fab)mentioning

confidence: 99%

See 1 more Smart Citation

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

Chang,

Porcino,

Rasch

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

Item response theory (IRT) is the statistical paradigm underlying a dominant family of generative probabilistic models for test responses, used to quantify traits in individuals relative to target populations. The graded response model (GRM) is a particular IRT model that is used for ordered polytomous test responses. Both the development and the application of the GRM and other IRT models require statistical decisions. For formulating these models (calibration), one needs to decide on methodologies for item selection, inference, and regularization. For applying these models (test scoring), one needs to make similar decisions, often prioritizing computational tractability and/or interpretability. In many applications, such as in the Work Disability Functional Assessment Battery (WD-FAB), tractability implies approximating an individual's score distribution using estimates of mean and variance, and obtaining that score conditional on only point estimates of the calibrated model. In this manuscript, we evaluate the calibration and scoring of models under this common use-case using Bayesian cross-validation. Applied to the WD-FAB responses collected for the National Institutes of Health, we assess the predictive power of implementations of the GRM based on their ability to yield, on validation sets of respondents, estimates of latent ability with uncertainty that are most predictive of patterns of item responses. IRT models in-general have the concrete interpretation of latent abilities, combining with item parameters, to produce predictions of response patterns. Our main finding is that regularized Bayesian calibration of the GRM outperforms the prior-free empirical Bayesian procedure of maximum marginal likelihood. We also motivate the use of compactly supported priors in test scoring.

show abstract

Work-related measures of physical and behavioral health function: Test-retest reliability

Cited by 10 publications

References 26 publications

Self-reported disability according to the International Classification of Functioning, Disability and Health Low Back Pain Core Set: Test-retest agreement and reliability

Self-reported disability according to the International Classification of Functioning, Disability and Health Low Back Pain Core Set: Test-retest agreement and reliability

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

Regularized Bayesian calibration and scoring of the WD-FAB IRT model improves predictive performance over marginal maximum likelihood

Contact Info

Product

Resources

About