Development of a Standardized Kalamazoo Communication Skills Assessment Tool for Radiologists: Validation, Multisource Reliability, and Lessons Learned

Brown, Stephen D.; Rider, Elizabeth A.; Jamieson, Katherine M.; Meyer, Elaine C.; Callahan, Michael J.; DeBenedectis, Carolynn M.; Bixby, Sarah D.; Walters, Michele; Forman, Sara F.; Varrin, Pamela; Forbes, Peter; Roussin, Christopher

doi:10.2214/ajr.16.17439

Cited by 20 publications

(12 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…95) in the IPCAT, and it was compatible with the ICC value of the Health Communication Assessment Tool (0.99) and the Common Ground Tool [ 18 , 34 ]. The Kalamazoo Communication Skills Assessment tool had an ICC range from 0.07 to 0.58 and was a low and moderate value compared to the IPCAT [ 35 ]. Therefore, the reliability findings of the IPCAT were compatible with most studies carried out in the communication skill assessment studies.…”

Section: Discussionmentioning

confidence: 99%

Development and validation of the interpersonal communication assessment tool for assessing the interpersonal communication skills of public health midwives

Prasanna

Abeysena

Alagiyawanna

2023

BMC Health Serv Res

View full text Add to dashboard Cite

Background Interpersonal Communication Skills (IPCS) are one of the core clinical skills that should be developed by the Public Health Midwives (PHMs), who are grass-root level public healthcare providers in primary healthcare settings in Sri Lanka. This study aimed to develop and validate the Interpersonal Communication Assessment Tool (IPCAT), an observational rating scale, to assess the IPCS of PHMs. Methods Item generation, item reduction, instrument drafting, and development of the tool’s rating guide were made by an expert panel. A cross-sectional study was conducted in five randomly selected Medical Officer of Health (MOH) areas, the smallest public health administrative division in the district of Colombo, Sri Lanka, to identify the factor structure, which is the correlational relationship between a number of variables in the tool. A sample of 164 PHMs was recruited. The data on IPCS were collected by video-recording the provider-client interaction using simulated clients. All recorded videos were rated by a rater using the drafted IPCAT, which included a Likert scale of 1(poor) to 5 (excellent). Exploratory factor analysis was conducted using the Principal Axis Factoring extraction method and the Varimax rotation technique to explore the factors. Three independent raters were used to rate ten randomly selected videos to assess the tool’s internal consistency and inter-rater reliability. Results The IPCAT obtained a five-factor model with 22 items, and all five factors explained 65% of the total variance. The resulting factors were “Engaging” (six items on making rapport), “Delivering” (four items on paying respect), “Questioning” (four items on asking questions), “Responding” (four items on empathy), and “Ending” (four items to assess the skills of ending a conversation productively). The internal consistency, Cronbach’s Alpha value, for all five factors was above 0.8, and the inter-rater reliability (ICC) was excellent (0.95). Conclusions The Interpersonal Communication Assessment Tool is a valid and reliable tool for assessing the interpersonal communication skills of Public Health Midwives. Trial registration Clinical Trial Registry, Sri Lanka. Ref No, SLCTR/2020/006(February 4th,2020)

show abstract

Section: Discussionmentioning

confidence: 99%

Development and validation of the interpersonal communication assessment tool for assessing the interpersonal communication skills of public health midwives

Prasanna

Abeysena

Alagiyawanna

2023

BMC Health Serv Res

View full text Add to dashboard Cite

show abstract

“…15 We recommend that the assessable training curriculum needs to explore ways to incorporate more work-based observation and reflection into increasingly flexible training and assessment. In light of our findings, RANZCR has recently selected and modified the "Gap-Kalamazoo Communication Skills Assessment Form," 23 Enablers and barriers to effective communication and collaboration include time pressure, which is difficult to address, and working with CALD patients which requires specialized training. Reducing jargon 5,24 and the use of metaphor can enhance patients' experience of communication.…”

Section: Discussionmentioning

confidence: 99%

“…We recommend that the assessable training curriculum needs to explore ways to incorporate more work‐based observation and reflection into increasingly flexible training and assessment. In light of our findings, RANZCR has recently selected and modified the “Gap‐Kalamazoo Communication Skills Assessment Form,” 23 in order to provide a more specific RO communication skills assessment tool. It has been included in the new training program.…”

Section: Discussionmentioning

confidence: 99%

Communication and collaboration skills training in Radiation Oncology in Australia and New Zealand: A qualitative study

Levy

Naehrig

Sullivan

et al. 2022

Asia-Pac J Clncl Oncology

View full text Add to dashboard Cite

Purpose Effective communication and collaboration with patients, carers and between healthcare professionals improves patient management. This study aimed to explore essential communication and collaboration skills training (CCST) for a radiation oncologist (RO) to inform competencies, learning outcomes and enhance curriculum training methods. Materials and Methods Eight focus group discussions with 10 fellows and 14 trainees of the Faculty of Radiation Oncology, Royal Australian and New Zealand College of Radiologists (FRO RANZCR) were conducted face to face between October 2018 and March 2019. Participants included doctors from culturally and linguistically diverse backgrounds, working in public and private, metropolitan, and rural sectors. Data were recorded, transcribed verbatim, managed in Excel, and coded using a qualitative content analysis framework. The study was approved by South Eastern Sydney Local Health District HREC (18/186). Participants provided informed written consent. Results After achieving thematic saturation, four predominant themes emerged. These were as follows: (1) Enablers and barriers to effective communication and collaboration; (2) written communication; (3) communicating bad news; and (4) multidisciplinary team meeting collaboration. Managing uncertainty and workplace culture emerged as interconnected sub‐themes. Conclusions There is a current lack of CCST in radiation oncology in Australia and New Zealand. The most common theme that emerged to improve CCST focused on increasing the exposure to a variety of communication and collaboration clinical scenarios, which are observed and upon which immediate structured feedback is given. Consultants and trainees offered tangible suggestions on how to improve the curriculum. These findings underscore the importance of using a combination of structured teaching methods and work‐based assessments. CCST templates are recommended.

show abstract

“…The questionnaire for self-assessment of communication skills developed in this study is also based on self-assessment and requires self-reflection and self-monitoring, which are essential for the process of lifelong learning and improvement. As compared to instruments eliciting specialty-specific communication-based competencies [12], self-assessment of communication skills has the potential to be applicable across various clinical specialties.…”

Section: Discussionmentioning

confidence: 99%

Development of a self-assessment tool for resident doctors’ communication skills in India

Baitha

Ranjan

Sarkar

et al. 2019

J Educ Eval Health Prof

View full text Add to dashboard Cite

Purpose: Effective communication skills are essential for resident doctors to provide optimum patient care. This study was conducted to develop and validate a questionnaire for the self-assessment of resident doctors’ communication skills in India.Methods: This was a mixed-methods study conducted in 2 phases. The first phase consisted of questionnaire development, including the identification of relevant literature, focus group discussions with residents and experts from clinical specialties, and pre-testing of the questionnaire. The second phase involved administering the questionnaire survey to 95 residents from the Departments of Medicine, Emergency Medicine, Pediatrics, and Surgery at the All India Institute of Medical Sciences, New Delhi, India in April 2019. Internal consistency was tested and the factor structure was analyzed to test construct validity.Results: The questionnaire consisted of 3 sections: (A) 4 items on doctor-patient conflicts and the role of communication skills in avoiding these conflicts, (B) 29 items on self-assessment of communication skills in different settings, and (C) 8 items on barriers to practicing good communication skills. Sections B and C had good internal consistency (Cronbach α: 0.885 and 0.771, respectively). Section C had a 2-factor solution, and the barriers were classified as ‘training’ and ‘infrastructure’ factors.Conclusion: This appears to be a valid assessment tool of resident doctors’ communication skills, with potential utility for identifying gaps in communication skills and developing communication skills modules.

show abstract

Development of a Standardized Kalamazoo Communication Skills Assessment Tool for Radiologists: Validation, Multisource Reliability, and Lessons Learned

Abstract: The adapted communication skills assessment instrument is highly relevant for radiology, having moderate interrater reliability. These findings have important implications for assessing the relational competencies of radiology trainees.

Cited by 20 publications

References 25 publications

Development and validation of the interpersonal communication assessment tool for assessing the interpersonal communication skills of public health midwives

Development and validation of the interpersonal communication assessment tool for assessing the interpersonal communication skills of public health midwives

Communication and collaboration skills training in Radiation Oncology in Australia and New Zealand: A qualitative study

Development of a self-assessment tool for resident doctors’ communication skills in India

Contact Info

Product

Resources

About