Twelve tips for adopting the virtual Nominal Group Technique (vNGT) in medical education research

Abstract

Nominal Group Technique (NGT) is a structured approach to consensus development and data collection driven by problem-solving, idea inception and prioritisation. Challenges of the coronavirus disease 2019 (COVID-19) pandemic necessitated the development of a virtual (vNGT) model to recruit participants from diverse locations and time zones. Our reflections reveal the opportunities and challenges of using Zoom© for NGT sessions, resulting in more effective engagement and focus with fewer distractions compared to in-person meetings. The 12 tips provide practical suggestions for expanding the versatility of NGT in a virtual environment. These recommendations cover every aspect of the process, including the person, place, and object, from planning the sessions, and utilising technology resources effectively, to ensuring a seamless implementation to desirable outcomes. The paper strives to assist individuals in effectively using the online NGT as a substitute for in-person events, promoting effective management of remote participants even during unprecedented times of quarantine and physical distancing.

Transnational higher education cultures and generative AI: a nominal group study for policy development in English medium instruction

“…In accordance with Humphrey-Murto et al (2023), the virtual nominal group technique (vNGT) is an adaptation of the methodology that convenes geographically dispersed participants online through video conferencing and collaborative editing platforms, with “many researchers having pivoted to online modalities since the 2019 COVID19 pandemic” (p. 6). Moreover, the range of digital tools available to facilitate its implementation offer notable affordances, such as the rapid sharing and structuring of ideas (Khurshid et al , 2023). The research design used here is illustrated in Figure 2.…”

ACcurate COnsensus Reporting Document (ACCORD) explanation and elaboration: Guidance and examples to support reporting consensus methods

“…ACCORD has been developed with the flexibility to apply to all methods or techniques used to achieve consensus, not only to the commonly used Delphi approach [1,3]. A non-comprehensive list of consensus methods used to measure, promote or gain consensus, and that can be reported using ACCORD is available in Table 1 [5][6][7][8][9][10][11][12][13][14]. Researchers may choose to adapt a standard method or to combine methods to fit their specific research needs.…”

Technology-Enhanced Learning in Medical Education Collection: Latest Developments

“…To date, the Technology-Enhanced Learning in Medical Education collection, part of MedEdPublish , has received submissions relating to several technologies to support learning, including web conferencing, web 2.0, e-textbooks, e-portfolios, software, generative artificial intelligence, simulation mannequins and wearables for point-of-view video, often in combination. Learning designs included flipped classroom with interactive case discussions ( Imran et al ., 2022 ), e-portfolios ( Javed et al ., 2023 ), didactic teaching followed by demonstrations of clinical skills on a simulation mannequin ( Zwaiman et al ., 2023 ), interdisciplinary case discussions to promote interprofessional learning ( Major et al ., 2023 ), patient panels to share narratives and perspectives ( Papanagnou et al ., 2023 ), and team-based learning ( Lee & Wong, 2023 ). In the four papers that included evaluation, participant reaction (feedback on learning activities) and/or learning (self-reported through surveys, with pre- vs post-training comparisons or at different timepoints during learning) were reported, corresponding to levels 1 and 2 of the commonly used outcomes-focused Kirkpatrick model of evaluation ( Allen et al ., 2022 ).…”

“…In the four papers that included evaluation, participant reaction (feedback on learning activities) and/or learning (self-reported through surveys, with pre- vs post-training comparisons or at different timepoints during learning) were reported, corresponding to levels 1 and 2 of the commonly used outcomes-focused Kirkpatrick model of evaluation ( Allen et al ., 2022 ). Two papers focused on the work of health professions educators, including conducting the nominal group technique, a qualitative research method, via web conferencing ( Khurshid et al ., 2023 ); and using ChatGPT to assist with various medical education tasks ( Peacock et al ., 2023 ).…”

“… Khurshid and colleagues (2023) provide tips for running the nominal group technique (NGT) using a web conferencing platform (virtual NGT, or vNGT). NGT is a qualitative research technique that uses a ‘structured approach to consensus development and data collection driven by problem-solving, idea inception and prioritisation’ which avoids one or a few participants dominating discussions as can occur in focus groups ( Khurshid et al ., 2023 ). Although prompted by COVID-19 lockdowns, the online NGT format proved more efficient than the in-person format, avoiding the need for participants to travel to a single location.…”