Use of a Multisource Feedback Tool to Develop Pharmacists in a Postgraduate Training Program

Abstract

Objectives. To evaluate use of a peer-assessment tool as a performance indicator for junior pharmacists in a formal postgraduate training program in London. Methods. A 4-year retrospective analysis of data gathered using the pharmacy mini-PAT (peerassessment tool) was undertaken. Assessments, including junior pharmacist self-evaluations, were conducted every 6 months. Overall performance and performance for clustered items were analyzed to determine changes. Assessments by healthcare professionals were then compared between professional groupings, which included pharmacists, physicians, and nurses.Results. There was a significant improvement over time in both self-assessment scores and scores on assessments conducted by others using the mini-PAT. Junior pharmacists rated themselves significantly lower than did their assessors ( p,0.001); pharmacist assessors rated the performance of junior pharmacists significantly lower than did other healthcare professionals ( p,0.001). Validity, ease of use, and relevance of the pharmacy mini-PAT were demonstrated. Conclusions. As part of a range of formative evaluations involving assessors from across various health professions, the mini-PAT is a valuable instrument for developing junior pharmacists. A cohort's mini-PAT result provides a snapshot of his/her performance that can be used to identify key areas requiring further training.

Alignment of CanMEDS-Based Undergraduate and Postgraduate Pharmacy Curricula in The Netherlands

“…A written self-reflection on a task performed which is afterwards discussed with an assessor or supervisor Multisource feedback (MSF) [54,55] Observations of trainees' competencies by other pharmacists in the working environment, by pharmacy technicians, general practitioners and patients. Data are collected with an electronic questionnaire, and include a self-assessment by the trainee Formative performance evaluation (FPE) [56] Systematic and structured evaluation of trainee functioning over an extended period, in which all dimensions of performance are taken into account.…”

Development and Validation of a Trustworthy Multisource Feedback Instrument to Support Nurse Appraisals

“…Most importantly, the scores arising from the MSF instrument appear to be trustworthy. Their psychometric characteristics (reliability) are at least as good as similar instruments used in other clinical disciplines . As always, reliable ratings depend on having a sufficiently wide sample of responses.…”

“…MSF is being used to inform appraisal in a number of nurse education programs. However, unlike other clinical disciplines, no nursing MSF instrument has been properly evaluated or validated anywhere in the world to the authors’ knowledge.…”

Development of Physical Therapy Practical Assessment System by Using Multisource Feedback

“…Moreover, MSF will promote the student to be one of the assessors (self-assessment). This is very useful for the students to assess themselves more precise and encourage student lifelong learning (Cox & Irby, 2007;Davies & Archer, 2005;Davies, Ciantar, Jubraj, & Bates, 2013;Overeem et al, 2010;Reinders et al, 2011;Wall, Singh, Whitehouse, Hassell, & Howes, 2012). However, there was no study about the application of MSF in formative manner for improving student performance in the clinical practice for physical therapy education.…”

“…The process of MSF will get valuable information of feedback which impacted to student's performance directly. Therefore, there were several studies suggested that MSF was a tool for improving student's competences such as communication, teamwork, patient management, and professional development (Bracken, Timmreck, & Church, 2001;Davies, Ciantar, Jubraj, & Bates, 2013;Violato, Worsfold, & Polgar, 2009). There are many elements involved when using MSF such as design and select instrument, select raters, collect data, analyze data, report feedback etc.…”