Research guidelines for the Delphi survey technique

Hasson, Felicity; Keeney, Sinead; McKenna, Hugh

doi:10.1046/j.1365-2648.2000.t01-1-01567.x

Cited by 3,600 publications

(1,989 citation statements)

References 32 publications

Supporting

Mentioning

1,917

Contrasting

Unclassified

Order By: Relevance

“…In the Second Round, participants had to score all items using a nine point Likert scale (one represented “fully disagree” and nine “fully agree”). During the analysis categories 7–9 were grouped as “in favour”/“agree,” categories 1–3 were grouped as “not in favour”/“disagree” and categories 4–6 were considered “neutral.”7 We defined consensus to have been reached if > = 75% of participants accepted (or rejected) a specific item 6. This scoring methodology had been revealed to the participants prior to the survey.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Outcome assessment for Brachial Plexus birth injury. Results from the iPluto world‐wide consensus survey

Pondaag

Malessy

2018

Journal Orthopaedic Research

View full text Add to dashboard Cite

There is no consensus regarding strategies to optimally treat children with a brachial plexus birth injury (BPBI). Comparison of outcome data presented by different centers is impossible due to the use of (1) many different outcome measures to evaluate results; (2) different follow‐up periods after interventions; and (3) different patient ages at the time of assessment. The goal of iPluto (international PLexus oUtcome sTudy grOup) was to define a standardized dataset which should be minimally collected to evaluate upper limb function in children with BPBI. This dataset must enable comparison of the treatment results of different centers if prospectively used. Three rounds of internet surveys were used to reach consensus on the dataset. A Delphi‐derived technique was applied using a nine point Likert scale. Consensus was defined as having attained a rating of 7/8/9 by > = 75% of the participants. A total of 59 participants from five continents participated in the Second and Third Rounds of the survey. Consensus was reached regarding four elements: (1) evaluation should take place at the age of 1/3/5/7 years; range of motion in degrees should be measured for (2) passive joint movement; (3) active range of motion; and (4) the Mallet score should be determined. Consensus on how to asses and report outcome for BPBI was only reached on motor items from the “Body Function and Structure” domain. Consensus regarding additional ICF domains to obtain a more elaborate set of outcome items, should be addressed in future research. © 2018 The Authors. Journal of Orthopaedic Research® Published by Wiley Periodicals, Inc. on behalf of the Orthopaedic Research Society. J Orthop Res 36:2533–2541, 2018.

show abstract

Section: Methodsmentioning

confidence: 99%

“…Its iterative multistage process was designed to transform opinion into group consensus 6. In short, questions are offered to participants of the surveys.…”

mentioning

confidence: 99%

Outcome assessment for Brachial Plexus birth injury. Results from the iPluto world‐wide consensus survey

Pondaag

Malessy

2018

Journal Orthopaedic Research

View full text Add to dashboard Cite

show abstract

“…Specifically, the objectives of the study were to develop the following: (1) a top 10 list of knowledge gaps and (2) a prioritized top 3 list of knowledge gaps. A modified Delphi method was used to develop consensus among an expert panel of leaders in the field 10, 11, 12, 13, 14. The Delphi method is a well‐described structured process for building consensus from a group of informed experts 10.…”

Section: Methodsmentioning

confidence: 99%

Delphi Analysis of Science Gaps in the 2015 American Heart Association Cardiac Arrest Guidelines

Panchal

Cash

Crowe

et al. 2018

JAHA

View full text Add to dashboard Cite

BackgroundCurrent cardiac arrest guidelines have limited high‐quality scientific evidence to support recommendations for care. The quality of scientific evidence on which guidelines are based may correlate with improved patient outcomes and meaningful survival. We sought to develop a prioritized list of knowledge gaps in resuscitation to assist researchers, policy makers, and funding agencies in their decision‐making process.Methods and ResultsA 4‐stage modified Delphi method was used with a panel of cardiac arrest experts. Experts addressed the prompt: “What are the top 3 gaps in knowledge involving cardiac arrest care that should be research priorities for National Institutes of Health/American Heart Association funding to have the greatest impact on public health?” Knowledge gaps were identified in the initial round, rated in a second round, and rank ordered in the third round, and they underwent final review and consensus (final round). The outcome was 10 knowledge gaps, with prioritization of the top 3 gaps. A total of 61 gaps, with 19 distinct themes, were identified by participants. The 10 knowledge gaps most likely to affect public health identified by the expert panel included, in order, the following: telecommunicator cardiopulmonary resuscitation, hemodynamic monitoring for goal‐directed resuscitation, reasons why bystanders fail to respond, optimization of postarrest care, out‐of‐hospital cardiac arrest identification and response, individualizing resuscitation strategies, predicting patients at risk, tools for neuroprognostication, optimal airway management, and optimizing educational strategies.ConclusionsTen priorities for cardiac arrest research were identified, but consensus was not reached on the prioritized top 3. Future research should address these gaps to potentially improve resuscitation guideline evidence quality.

show abstract

“…This method has been successfully followed in radiotherapy research as well as other research fields. [36][37][38][39][40][41][42] Since no patients were involved in our surveys, the law in the Netherlands does not require ethics clearance. Figure 1.…”

Section: Methodsmentioning

confidence: 99%

How to measure innovation in radiotherapy: an application of the Delphi method

Jacobs

Boersma

Dekker

et al. 2015

JHA

View full text Add to dashboard Cite

Objective: Innovation is an important driver for improving the quality of health care, yet a tension exists between innovation and providing cost-effective health care. To develop strategies that promote innovation, parameters are needed that are indicative of innovation. However, no recognised indicators of innovation in radiotherapy are currently available. The aim of this study is to fill that gap by providing a framework for measuring innovation. This should facilitate future multi-centric studies on strategies aimed at promoting innovation in radiotherapy. Methods: We applied the Delphi method in four rounds. The chairpersons of all Dutch radiotherapy departments were asked to suggest indicators. The resulting inventory was assessed by a number of Dutch radiation oncologists, medical physicists and managers. After implementig a cut-off score on suitability and measurability, we asked Dutch professors on innovation to assess the remaining indicators. Finally, the chairpersons reached consensus. Results: On the basis of the Delphi study, we derived 13 indicators in four categories, more specific product innovation, technology innovation, market innovation and organisational innovation, for measuring both incremental and radical innovations in radiotherapy; these indicators are also suitable for measuring the generation and adoption of innovations. Conclusions: We were successful in reaching consensus amongst the experts on indicators that measure innovations in radiotherapy. The developed tool will be used to investigate the relation between innovation and possible factors inhibiting or stimulating successful innovation and between the level of innovation and its effects.

show abstract

Research guidelines for the Delphi survey technique

Cited by 3,600 publications

References 32 publications

Outcome assessment for Brachial Plexus birth injury. Results from the iPluto world‐wide consensus survey

Outcome assessment for Brachial Plexus birth injury. Results from the iPluto world‐wide consensus survey

Delphi Analysis of Science Gaps in the 2015 American Heart Association Cardiac Arrest Guidelines

How to measure innovation in radiotherapy: an application of the Delphi method

Contact Info

Product

Resources

About