Evaluation of immediate impact of Faculty Development Programme using a pretest–post-test study design format

Abstract

Background Workshops are the most common models to enhance knowledge and skills in a specific subject area with an intent to explore, solve a problem and/or innovate new things. The most important aspect of a workshop is the transfer of knowledge in a safe learning environment as a faculty development activity (FDA). At International Medical University (IMU), Malaysia’s first private medical university which was established in 1992, Faculty Development Programmes (FDPs) are run throughout the year in order to enhance the knowledge and skills in teaching and assessment. In order to sustain this faculty development, IMU has a dedicated medical education unit called the IMU Centre of Education (ICE) with dedicated staff and respected faculty developers who are academic role models to the faculty of the institution. However, FDA are collaboratively run by ICE and IMU Centre for lifelong learning (ICL). Objectives To determine the immediate impact of faculty development workshops for health professionals in teaching schools of IMU to enhance the teaching and assessment abilities of the faculty. Methodology A retrospective quantitative research design was developed to collect data from multiple standard setting workshops using a 3-point Likert scale. A 20 items questionnaire as a pretest from the participants with and without the prior reading of online posted reading materials. An interventional hands-on workshop and a post-test score, using the same 20 items questionnaire, followed the workshop intervention. A collated quantitative data were gathered from a sample of 139 participants attending the standard setting workshops. Data were analysed using paired t test, one-way ANOVA and ANCOVA with effect size in SPSS version 24. Results A mean difference between pretest and post-test score was significant at t (138) = 92.24, p < 0.01. A barely significant difference of mean scores between pre-read, partially read and not-read participants was found at F (1, 136) = 9.402, p = < 0.05 and η2 = 0.121 by one-way ANOVA. A post-test difference of the mean scores across those read, partially read and not-read for reading materials on a controlled pretest score determined by one-way ANCOVA remained non-significant at F (1, 136) = 0.240, p = 0.787 associated with a practical effect size = 0.4% only. Conclusion A significant difference of the mean pretest and post-test score within the group was also significant between the groups. A post-test score, controlling on pretest score, was found not significant and is suggestive of an effectively delivered workshop for all participants. As a practical guide, a 7-step plan is recommended to ensure immediate impact of FDP. Majority of the participants rated the workshop as good in terms of content, organisation, delivery and usefulness. A high percentage of survey respondents reported that similar workshops to be offered in future.

Advancing teacher competencies: assessing the influence of faculty development programs (FDP) on embracing modern innovations in teaching

“…Hassan et al. (2021a, b) noted a significant improvement in the faculty knowledge indicating an immediate positive impact of FDPs. A four-year-long empirical study (Quirk et al.…”

“…Similarly, Hassan et al. (2021a, b) underlined the critical nature of FDPs in enhancing knowledge, skills, and overall quality of education.…”

Promoting Shared Academic Paths Through University Alliances: A Survey for The Investigation of Teachers’ Training Needs

“…In the early years, moreover, many studies proved the efficiency of Faculty Development initiatives to promote teachers' professional development and support in their teaching academic career (Hassan et al, 2021). Especially in the medical education, indeed, we have evidences of the relevant impact of Faculty Development programs in changing faculty's behaviour in terms of teaching and learning, thanks to case studies (Stake, 1995) which analyzed, through questionnaires and pre/post tests, the changes in teachers' willingness and awareness on their educational role (Lee et al, 2018).…”

Efficacy of Faculty Development Training Workshops (FDTWs) on Writing High-Quality Multiple-Choice Questions at Northern Border University (NBU) in the Kingdom of Saudi Arabia (KSA)

“…These include interest in the participants, previous training sessions attended, exposure to reading material, level of seriousness, and renewed interest in the concept being elaborated. A study conducted on the impact of workshops on topics pertaining to medical education technologies concluded that knowledge levels increased immediately after attendance, decreasing at two months, and then reverting at six months [ 21 ]. This variation in the ability of participants to recall and utilize the information given to them through FDTW can be used to determine the frequency at which FDTW should be organized.…”