Quality indicators for Delphi studies

Abstract

The Delphi method is a technique of social research that seeks to obtain a reliable group opinion from experts. It was first created for military purposes in the mid‐1950s. Since then, its use in the scientific field has continued to spread to different disciplines and aims. Despite this expansion, however, not set of indicators of the quality of Delphi studies has yet to be developed that might provide the reader—whether an expert in the technique or not—with some framework of reference whereby to gauge what credibility should be afforded to the results of the study. In this paper, following a thorough review of the literature on the criteria used to assess Delphi studies and the items of evaluation recommended for inclusion in Delphi reports, we determine what characteristics a quality evaluation indicator for this technique should have and propose a battery of indicators based on these characteristics, which should for preference be included in the final report of a Delphi study. The proposed indicators focus on three areas that are particularly relevant to the quality of Delphi research: the quality of the panel of participating experts, the way in which relevant information is obtained from the experts, and the quality of the interaction generated among the experts.

Management from a multidisciplinary perspective of phlebitis related to peripheral venous catheter insertion: An international Delphi study

“…The Delphi method is a social research technique which seeks to obtain a reliable collective opinion from a group of experts (Landeta & Lertxundi, 2024 ). Its main characteristics include it being: (1) an iterative process (minimum of two rounds); (2) with anonymity among the experts (avoiding undesired influences); (3) with controlled feedback and (4) with statistical analysis of the group's answers (Landeta & Lertxundi, 2024 ).…”

“…This initial bibliometric analysis, therefore, allowed, firstly, the systematic identification of relevant experts at global level (institutions and authors), enabling us to contact and invite them onto the panel of experts. Selecting the experts is a crucial aspect in Delphi studies (Landeta & Lertxundi, 2024 ; Nasa et al., 2021 ). It secondly allowed us to detail general aspects for investigation on the topic of the management of phlebitis due to vascular access.…”

“…Selecting the experts is a crucial aspect in Delphi studies (Landeta & Lertxundi, 2024;Nasa et al, 2021). It secondly allowed us to detail general aspects for investigation on the topic of the management of phlebitis due to vascular access.…”

Assessment, Treatment, and Follow-Up of Phlebitis Related to Peripheral Venous Catheterisation: A Delphi Study in Spain

“…This is a structured process to systematically collect expert judgements on a problem, process the information, and, using statistical resources, determine the general consensus of the group and rank the solutions to the problem [17,18]. It is a social research technique that seeks to obtain a reliable collective opinion from a group of experts [19]. The guidelines (Supplementary Materials) recommended for Delphi studies (CREDES) [20] were followed.…”