Inter-rater reliability in disability assessment based on a semi-structured interview report

Spanjer, Jerry; Krol, Boudien; Brouwer, Silvia; Groothoff, Johan W.

doi:10.1080/09638280701688185

Cited by 33 publications

(32 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Apparently the implementation strategy contributed to more uniformity in work limitations assessments by IPs. This ties in well with earlier research into variation in work disability assessments [16,17]. In terms of financial and social consequences, such variation is unwanted for both the client and society and in our opinion might be reduced by the use of standardised methods of assessment, as occurs when guidelines are applied.…”

Section: Discussionsupporting

confidence: 79%

The influence of applying insurance medicine guidelines for depression on disability assessments

et al. 2013

View full text Add to dashboard Cite

BackgroundIn the current study we report on the effects of an implementation strategy in the form of a training programme on the assessed work limitations of a client with depression by insurance physicians (IPs) participating in a RCT. These assessed work limitations of a client were in the form of scores on the List of Functional Abilities (LFA).MethodWe conducted a randomised controlled trial (RCT) for IPs in which we compared the intervention of a specially developed training programme with the usual methods of implementation and training currently used. The outcome was the mean sum score and the inter-rater reliability (Intraclass Correlation Coefficient, ICC) of the LFA scores. These LFA scores were scored by the IPs participating in the RCT for the work limitations of the cases presented in different videos, two videos before the training and two after the training of the intervention group.ResultsAt baseline, the intervention group (IG) consisted of 21 IPs and the control group (CG) of 19. For one participant of the IG and for one of the CG the LFAs of the two case reports after training were not available. Before training the sum scores for the first case report did not differ significantly between the groups, while the mean sum score was higher in the IG than in the CG for the second case report. For both case reports after training a higher score was found in the IG than in the CG. The inter-rater reliability measured for the two case reports before training was about the same in the IG and the CG: 0.64 and 0.65, respectively. For the two case reports after training, the ICC was higher in the IG than in the CG: 0.69 and 0.54, respectively. This difference was not significant however.ConclusionIt would appear that the implementation of a specially designed training programme on guidelines for depression may lead to greater inter-rater reliability in the assessments by insurance physicians of the work limitations of clients with depression. It is, however, important to note that insurance physicians who receive training may find more work limitations than those who do not.Trial registrationNetherlands’ Trial Register NTR1863

show abstract

Section: Discussionsupporting

confidence: 79%

The influence of applying insurance medicine guidelines for depression on disability assessments

et al. 2013

View full text Add to dashboard Cite

show abstract

“…psychological or cognitive symptoms) [10–13]. Aspects of physical health tend to yield higher levels of patient-physician agreement as compared to aspects of mental health or well-being [14,15]. For example, one recent study reports up to a 20% discordance between patient reported anxiety and physician estimation of patient anxiety among oncology patients [13].…”

Section: Introductionmentioning

confidence: 99%

Do claimants over-report behavioral health dysfunction when filing for work disability benefits?

Marfeo

Eisen

et al. 2015

WOR

View full text Add to dashboard Cite

BACKGROND Questions exist related to the best way to use medical evidence relative to self-report as part of the SSA disability determination process. OBJECTIVE To examine concordance between provider and claimant responses along the four dimensions of work related behavioral health functioning: Social Interactions, Mood and Emotions, Behavioral Control, and Self-Efficacy. METHODS Using secondary data from a larger study, which collected data on individuals reporting difficulties with work (claimants) due to mental conditions, 39 items were completed by claimants and their healthcare provider. Inter-rater agreement was assessed using three techniques: Cohen’s kappa, percent absolute agreement, and folded mountain plots. RESULTS A sample of 65 dyads was obtained. Inter-rater agreement was low for most items (k = 0.0–0.20) with a minority of items having fair agreement (k = 0.21–0.40) Percent agreement was fair: Mood and Emotions (46%), Self-Efficacy (44%), Behavioral Control (39%) and Social Interactions (38%). Overall, providers reported lower functioning compared to claimants for the Behavioral Control and Self-Efficacy scales; the reverse trend held for the Mood and Emotions scale. CONCLUSIONS Results indicate discordance between provider and claimant report of behavioral health functioning. Understanding reasons for and approaches to reconciling the inconsistencies between claimant and provider perspectives is a complex task. These findings have implications for how best to assess mental and behavioral-health related work disability in the absence of an established gold standard measure.

show abstract

“…When we see a patient showing a some what abnormal movement on sitting, it may not be easy to point out how and what is abnormal about it. In addi tion, the evaluation of normality may vary among in vestigators [4][5][6]. Distinguishing between normal and pathologic movements is often difficult, and it is not easy to decide what is normal for a daily movement [13].…”

Section: Discussionmentioning

confidence: 99%

“…Although therapists observe and detect abnormal and disabled behaviors during each movement, it is not always easy to evaluate quantitative improvement/de terioration of the movement through visual observation. In addition, the reliability and variation in skill levels among therapists are marked [4][5][6].…”

Section: Introductionmentioning

confidence: 99%

Kinematic Analysis of Seating Maneuver: Digitalization of Movement in Daily Living

Takei¹,

Shimizu²,

Hoshiyama³

2010

Human Movement

View full text Add to dashboard Cite

Purpose. The objective of the present study was to digitally express a common daily movement of sitting down (seating maneuver), and to show an analytical example of normative indices of such a daily movement. Basic procedures. Sequential traces of moments and the center of pressure (COP) during the seating maneuver, approaching with steps to and sitting on a stool, were measured using two force plates, and we decided on normal ranges of parameters based on the vertical moment and lateral deviation of the COP. In addition to the normal data recorded from ten healthy subjects, a data set from a patient was plotted. Main findings. Normative indices to express the sequential movement were obtained. The patient showed abnormal values of the indices, which could be quantitative indicators to evaluate the normality and grade of abnormality. Conclusions. We introduced a method for the quantitative screening of a daily movement using force plates. The results showed normative values, and the method could be used to reveal abnormalities in a daily movement in a patient with mild movement disability.

show abstract

Inter-rater reliability in disability assessment based on a semi-structured interview report

Cited by 33 publications

References 11 publications

The influence of applying insurance medicine guidelines for depression on disability assessments

The influence of applying insurance medicine guidelines for depression on disability assessments

Do claimants over-report behavioral health dysfunction when filing for work disability benefits?

Kinematic Analysis of Seating Maneuver: Digitalization of Movement in Daily Living

Contact Info

Product

Resources

About