Further Evaluation of the Validity and Reliability of the Performance Diagnostic Checklist-Human Services

Cymbal, Daniel; Wilder, David A.; Thomas, Rachel; Ertel, Hallie

doi:10.1080/01608061.2020.1792027

Cited by 10 publications

(20 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We found no meaningful difference in accurate domain identification across vignettes. The overall mean accuracy score for this study was slightly higher than the corresponding score obtained by Cymbal et al (2020 The accuracy with which users completed the PDC-HS (1.1) varied slightly across participant experience levels and video vignettes. Participants with master's degrees scored the highest for the first and second vignettes and second highest for the third.…”

Section: Discussioncontrasting

confidence: 64%

“…The overall mean interrater reliability score, calculated from random participant pairings within each experience group, was 85.92% (SD = 6.58; see Table 5). Similar to Cymbal et al (2020), interrater agreement scores varied across the three groups, with the undergraduate group (M = 82.57%, SD = 6.58) being lower than both the…”

Section: Interrater Reliabilitymentioning

confidence: 70%

“…Future studies may consider other statistical approaches to evaluating the validity and reliability of the PDC-HS (1.1) in addition to the measures reported here and in previous studies (Cymbal et al, 2020;Wilder et al, 2019). For example, researchers could measure the internal consistency of the assessment using Cronbach's alpha (Cronbach, 1951).…”

Section: Discussionmentioning

confidence: 97%

“…It was expected that a less contrived script that more closely resembled real‐world use of the PDC‐HS would affect the accuracy and reliability of the assessment, and this was confirmed. Nevertheless, the results were still promising and suggest that the PDC‐HS accurately measures what it is intended to measure (Cymbal et al, 2020).…”

mentioning

confidence: 99%

“…Each script depicted clear and unambiguous answers, which may be unlikely to occur in many organizations. Cymbal et al (2020) replicated and extended Wilder et al (2019) by basing the video vignettes on actual interviews in which the PDC-HS was used to address realworld performance concerns. Participants were instructed to watch the vignettes and score them accordingly.…”

mentioning

confidence: 99%

See 4 more Smart Citations

The Performance Diagnostic Checklist–Human Services (1.1): An initial assessment of validity and reliability

Jimenez,

Wilder,

Brand

et al. 2023

J of App Behav Analysis

Self Cite

View full text Add to dashboard Cite

The Performance Diagnostic Checklist—Human Services (PDC‐HS) is an assessment used to identify variables contributing to staff performance concerns in human‐service settings. In the current study, we introduce and assess the test validity, interrater reliability, and test–retest reliability of the PDC‐HS (1.1), a revised version of the assessment that included revised instructions, questions, and intervention planning references. We measured the psychometric properties of the revised assessment by analyzing answers obtained from watching video vignettes of simulated interviews between consultants and a supervisor. Twenty‐one participants watched the vignettes and completed the PDC‐HS (1.1) based on the answers provided during the interview. We also included an item analysis to identify questions on which participants made errors and an intervention selection task to assess whether participants selected an appropriate intervention to target the indicated domain. The results support the use of the PDC‐HS (1.1) in human services settings.

show abstract

Section: Discussioncontrasting

confidence: 64%

Section: Interrater Reliabilitymentioning

confidence: 70%

Section: Discussionmentioning

confidence: 97%

mentioning

confidence: 99%

mentioning

confidence: 99%

See 3 more Smart Citations

The Performance Diagnostic Checklist–Human Services (1.1): An initial assessment of validity and reliability

Jimenez,

Wilder,

Brand

et al. 2023

J of App Behav Analysis

Self Cite

View full text Add to dashboard Cite

show abstract

Performance Diagnostic Assessment

Wilder,

Cymbal,

Echeverria

2024

Evidence-Based Practices in Behavioral Health

View full text Add to dashboard Cite

Impact of COVID-19 on the Applied Behavior Analysis Workforce: Comparison across Remote and Nonremote Workers

Jimenez‐Gomez

Sawhney

Albert

2021

Behav Analysis Practice

View full text Add to dashboard Cite

With the abrupt transition to observing physical distancing as a result of COVID-19, applied behavior analysts were faced with the sudden need to modify their service delivery model, while at the same time managing personal difficulties brought about by the pandemic. The present article provides a description of the impact of COVID-19 on the behavior analyst workforce currently providing clinical services in the United States. We conducted a survey to assess work conditions, burnout, and productivity of behavior analysts at various certification levels. These data provide a snapshot of the impact of COVID-19 on the workforce. Overall, one third of the participants reported experiencing job insecurity, and almost half of participants reported decreased productivity and increased burnout, with remote workers more severely affected. Taken together, these factors could compromise the ability of behavior analysts to adequately provide services to their clients. We provide recommendations for behavioral health agencies for supporting staff during extreme situations such as a pandemic.

show abstract

Further Evaluation of the Validity and Reliability of the Performance Diagnostic Checklist-Human Services

Cited by 10 publications

References 7 publications

The Performance Diagnostic Checklist–Human Services (1.1): An initial assessment of validity and reliability

The Performance Diagnostic Checklist–Human Services (1.1): An initial assessment of validity and reliability

Performance Diagnostic Assessment

Impact of COVID-19 on the Applied Behavior Analysis Workforce: Comparison across Remote and Nonremote Workers

Contact Info

Product

Resources

About