The Performance Diagnostic Checklist–Human Services (1.1): An initial assessment of validity and reliability

Abstract

The Performance Diagnostic Checklist—Human Services (PDC‐HS) is an assessment used to identify variables contributing to staff performance concerns in human‐service settings. In the current study, we introduce and assess the test validity, interrater reliability, and test–retest reliability of the PDC‐HS (1.1), a revised version of the assessment that included revised instructions, questions, and intervention planning references. We measured the psychometric properties of the revised assessment by analyzing answers obtained from watching video vignettes of simulated interviews between consultants and a supervisor. Twenty‐one participants watched the vignettes and completed the PDC‐HS (1.1) based on the answers provided during the interview. We also included an item analysis to identify questions on which participants made errors and an intervention selection task to assess whether participants selected an appropriate intervention to target the indicated domain. The results support the use of the PDC‐HS (1.1) in human services settings.

Review of The Supervisor's Guidebook: Evidence‐Based Strategies for Promoting Work Quality and Enjoyment Among Human Service Staff (2nd edition) by Dennis Reid, Marsha Parsons, and Carolyn Green

“…The chapter lacked information about the use of performance assessment to identify barriers to desired staff performance, which would benefit readers. For example, the Performance Diagnostic Checklist‐Human Services (Carr et al, 2013; Jimenez et al, 2023) has empirical support and can be a helpful instrument in determining how to support staff who do not meet performance standards. Although a common reason for underperformance is low motivation, other reasons involve flawed processes or missing or broken resources, which were not addressed in this chapter.…”

“…The authors essentially describe a behavior‐analytic approach to addressing staff performance problems. Like Chapter 8, it would have been helpful to describe the beneficial use of the Performance Diagnostic Checklist‐Human Services (Carr et al, 2013; Jimenez et al, 2023) in this chapter. A strength of this chapter is an acknowledgment of situations supervisors might face that make it difficult to effectively supervise or that disrupt effective supervision (e.g., upper‐level management shows favoritism to staff).…”