Evaluation of an ultrasound program in nationwide Continuing Professional Development (CPD) in Korean public health and medical institutions

Abstract

Background The Education and Training Centre for Public Healthcare of the National Medical Centre plays a key role in providing continuing professional development (CPD) to 221 public health and medical institutions in South Korea. To assess the realization of the Centre’s core value and the intended changes, program evaluations are required. The context, input, process, and product (CIPP) model is particularly suitable for evaluating CPD in the public sector, as it allows for recognizing the dynamic nature of the program environment. Methods This research applied the CIPP model to the evaluation of CPD programs, particularly abdominal and thoracic ultrasound programs implemented in 2017 and 2018. Data were collected from 2017 to 2019. The program and its feedback were reviewed in the context evaluation. Based on this, a subsequent program strategy was established for the input evaluation. Observing the program in real time and recording its progress was followed in process evaluation. Finally, the outcomes and impacts of the program were reviewed and compared with baseline data in the product evaluation. Results In context evaluation, the educational needs of the Centre’s CPD program recipients, impediments that inhibit participation in education, and resources that the Centre can utilize were identified through an online survey, focus group interviews and expert consultation. Through input evaluation, we identified the best alternative that satisfied all pre-selected criteria, which were responsiveness to priority system needs, potential effectiveness, fit with existing services, affordability, and administrative feasibility. Observing the program in real time and recording its progress were conducted in process evaluation, demonstrating that the augmented program went as planned, and even had to be expanded due to increased demand. The impact of the program was measured, interpreted, and assessed in the product evaluation. The review committee decided that the intended change had been occurred, thus the Centre decided to maintain the program. Conclusion A thorough evaluation is necessary to determine the potential benefits of CPD. The CIPP methodology is valuable for executing formative and summative evaluations. The CIPP model is particularly useful for securing accountability data for large-scale nationwide educational programs supplied by public funds.

Evaluation of the Utilization of the Learning Management System (LMS) Using the CIPP Model

“…The model's flexibility and adaptability make it a valuable tool for assessing different educational initiatives and programs (Duan et al, 2023). Additionally, the CIPP model has been utilized in the evaluation of medical education programs, such as palliative care longitudinal curricula (Besterman-Dahan et al, 2023) and medical humanities courses (Kim et al, 2022), demonstrating its versatility across diverse educational domains.…”

“…Moreover, the CIPP model has been instrumental in evaluating programs beyond traditional education, such as urban agriculture programs (Kim et al, 2022), entrepreneurship education in higher education (Sagin et al, 2024), and talent cultivation quality in modern apprenticeships (Bodur et al, 2022). Its application in assessing the effectiveness of various educational programs underscores its relevance and utility in different educational settings.…”

“…Moreover, utilizing evaluation models like the Context Input Process Product (CIPP) model can be beneficial in assessing the effectiveness of faculty engagement strategies in LMS adoption (Kim et al, 2022). The CIPP model provides a structured framework for evaluating programs by considering the context, input, process, and product aspects, allowing institutions to tailor their approaches based on feedback and outcomes.…”

Program evaluation of postgraduate obstetrics and gynecology training in Lao people’s democratic republic - using the CIPP model

“…CIPP is widely used to evaluate the initiatives and interactions and to identify its strengths and weaknesses in medical education research including graduate medical education [ 1 , 6 – 8 ]. Moreover, this method is widely used not only evaluating programs in graduate medical education [ 9 ], but also in continuous professional development [ 10 ].…”

Assessment of a training project of English as a media of instruction(EMI) using Kirkpatrick model

“…KMU cooperated with the British Council and conducted three sessions of the EMI training project during 2017-2019. Although, training-specific evaluation is valuable to determine the effectiveness of the training and changes in the knowledge and competencies of the trainees [6], and is important to assess whether the program is tailored to meet the needs and objectives of the program [7]. But this training project has not yet applied an appropriate or systematic approach to analyze and evaluate its effectiveness.…”