Feasibility of Virtual Focus Groups in Program Impact Evaluation

Abstract

Focus groups are often used for qualitative investigations. We adapted a published focus group method for evaluating impact of an organizational intervention for virtual delivery using video conferencing. The method entailed convening small groups of three to five participants for a 2-hour facilitated workshop. We delivered the virtual workshops, adding qualitative evaluation with researchers and participants, to assess the effectiveness of the protocol. We address the questions of how to structure the data collection procedures; whether virtual delivery permits cross participant interactions about a studied intervention; and how easy and comfortable the experience was for participants. Participants were university faculty members who were the focus of an institutional diversity program. The results indicated that the virtually delivered focus group workshop could be successfully implemented with strong fidelity to the original protocol to achieve the workshop goals. The workshops generated rich data about the impacts of the institutional program as well as other events and conditions in the working environment that were relevant to consider along with the observed program outcomes. A well-planned virtual focus group protocol is a valuable tool to engage intervention stakeholders for research and evaluation from a distance. Video conferencing is especially useful during the current COVID-19 pandemic, but also whenever geography separates researchers and evaluators from program stakeholders. Careful planning of privacy measures for a secure online environment and procedures for structured facilitation of group dialogue are critical for success, as in any focus group. This article addresses a gap in the literature on feasibility and methodology for using video conference technology to conduct qualitative data collection with groups.

Framing the futures of animal-free dairy: Using focus groups to explore early-adopter perceptions of the precision fermentation process

“…All of the focus groups were held virtually via video conferencing software, due to the ongoing Covid-19 pandemic and the desire to collect data from international samples. We followed a set of best practices for virtual focus groups, including the recruitment of smaller groups of participants than is customary for in-person research, the use of a familiar video-conferencing platform (Zoom), and the employment of slides as visual aids, among other tactics ( 35 , 36 ). Participant recruitment was aided by a professional global research platform (Testing Time), and participants received a monetary honorarium equivalent to €40 via that platform after their focus group concluded.…”

Dematerialized participation challenges: Methods and practices for online focus groups

“…COVID-19 prompted discussion on conducting qualitative research in the pandemic era, and there exists a growing body of literature on the practical, technical, and ethical protocols of virtual research modalities, such as video interviews or OFGs. Reflections have included considerations on participant recruitment, ethical consideration about data privacy, and participant digital literacy (Nobrega et al, 2021 ; Keen et al, 2022 ; Monaco, 2022 ). OFGs can become a methodological tool to conduct high-quality and rigorous qualitative research in a context of crisis and beyond, involving a large audience of people by dematerializing participation and thus encouraging green investments.…”

Virtual OSCE Delivery and Quality Assurance During a Pandemic: Implications for the Future

“…Focus group discussions (FGDs) were chosen to facilitate discussion and interactions within a nurturing environment ( 21 ), to explore the experiences and perspectives of all stakeholders through the lens of QA and utility of the new assessment format and were conducted online using the Zoom videoconferencing platform. The use of virtual focus groups in qualitative research was necessitated during the global pandemic, with good feasibility and acceptability ( 22 , 23 ). To this end, our study utilized a virtual approach for the focus group discussions.…”