Evaluating the Psychometric Properties of a Clinical Vocational Rehabilitation Outcome Measurement: The Assessment of Work Performance (AWP)

Abstract

This study examined the validity and reliability of the Assessment of Work Performance (AWP) using Rasch analysis. The AWP was administered to 365 clients with a variety of work-related problems. Rasch analysis and principal component analysis were used to examine the appropriateness of the rating scales and unidimensionality of AWP items. The person-response validity, internal consistency, targeting appropriateness, and differential item function were also analyzed. The Rasch analysis confirmed the 4-point rating scale, and the item set met the criteria of unidimensionality. The AWP exhibited satisfactory person-response validity and internal consistency. Among the three subdomains, the targeting of item-difficulty was sufficient in the motor skills and process skills subdomains. Differential item functioning was found across gender and diagnoses. This study presented evidence to support that the AWP functioned as a reliable and valid assessment in assessing work performance. [OTJR: Occupation, Participation and Health 2013;33(3):125-133.].

Initial evaluation of psychometric properties of a structured work task application for the Assessment of Work Performance in a constructed environment

“…Assessors often have specific directions depending on their commission and finding an optimal assessment situation can be a challenge. Therefore a constructed environment is a necessary option to real environment [29]. In this study, the participants also preferred assessment in a real environment but stated that assessing clients in a constructed environment could be a strength since it provided an opportunity for clients to practice on work tasks in a safer environment, and also prevented poor relations with co-workers and supervisors from affecting the assessment and in the longer term influencing the possibility to remain at work, since relations at work have been shown to affect work ability [37][38].…”

“…Construct validity, content validity, face validity, internal consistency reliability and utility have previously been tested for the AWP [26][27][28][29].…”

Is a structured work task application for the assessment of work performance in a constructed environment, useful for patients with attention deficits?

“…The AWP has shown sound psychometric properties concerning face, content, construct, and social validity, internal consistency, and utility [61,[63][64][65]. The result of a questionnaire (n ¼ 21) with open-ended questions concerning adequacy, the content of variables, clarity and comprehensibility, manageability, learning time, and layout indicated a satisfactory face validity and utility for use within vocational rehabilitation [61].…”

“…The observation method AWP [61], was selected in order to investigate the effect of intensive attention training on post-ABI work performance, in a constructed environment such as a clinical setting in a hospital. The AWP evaluates how efficiently and appropriately a person performs a task in terms of motor, process, communication, and interaction skills (Table 1) [63]. The AWP is a frequently used observation assessment in vocational rehabilitation and has been chosen as the national assessment instrument to be used by occupational therapists [63,64] of the Swedish Social Insurance Administration.…”

“…The AWP evaluates how efficiently and appropriately a person performs a task in terms of motor, process, communication, and interaction skills (Table 1) [63]. The AWP is a frequently used observation assessment in vocational rehabilitation and has been chosen as the national assessment instrument to be used by occupational therapists [63,64] of the Swedish Social Insurance Administration. It can be used in various settings and tasks, as it aims to assess a persons skills when performing a specific task.…”