Delphi research: issues raised by a pilot study

Abstract

Pilot studies in Delphi research provide useful guidance about first-round questions as well as measurement methods, consensus thresholds and controlled feedback in subsequent rounds. They support the involvement of professionals and service users and they need to trial the recruitment strategy to avoid between-round delays. Delphi researchers should publish details of their approach to pilot studies.

Towards a standardised definition for fundamental care: A modified Delphi study

“…A modified Delphi method was used. The Delphi method involves repeated, anonymous surveying of experts in a field to reach consensus on topics where it is lacking, or when there is a limited body of knowledge on which to build a scientific study (Clibbens, Walters, & Baird, ; Fox et al., ; Thompson, McArthur, & Doupe, ). The modified method can involve face‐to‐face discussion amongst participants (Eubank et al., ; Foth et al., ), a technique used in this study.…”

Applying the Delphi method to generate interventions to reduce unnecessary interruptions in clinical nursing

“…This pilot study was used to prepare the first-round panel meeting to choose interventions to reduce interruptions. 27,28 We selected the Delphi method (Delphi) to develop meaningful interventions to reduce unnecessary interruptions for nursing leaders and staff. In this paper we focus primarily on describing the panel process of this method.…”

“…Some have made the criterion for consensus at 80% of the panellists' scoring within two categories on a seven-point scale; others recommend that at least 70% of the panellists rate three or more on a four-point Likert Scale with a median at 3.25 or higher. 27,29,35 Nevertheless, the use of different scales and different cut-off points makes it difficult to compare our results with others. 26,36 The facilitators chose only to present the statements from the pilot study, not the findings of the interviews and observations, to avoid the impact of panellists' preunderstanding of interruptions and to make the process as objective as possible.…”

“…In addition, the panellists prepared a two-minute presentation on the open-ended question: how do interruptions impact on the working environment? [26][27][28] First-round panel meeting: This meeting featured only reflection and no dialogue. The first round is typically qualitative and designed to ascertain the broadness of the topic for the panellists.…”

“…The first round is typically qualitative and designed to ascertain the broadness of the topic for the panellists. 26,27 Initially, each participant gave a two-minute presentation. The other panellists were not allowed to comment or interrupt.…”