The Delphi List

Abstract

Most systematic reviews rely substantially on the assessment of the methodological quality of the individual trials. The aim of this study was to obtain consensus among experts about a set of generic core items for quality assessment of randomized clinical trials (RCTs). The invited participants were experts in the field of quality assessment of RCTs. The initial item pool contained all items from existing criteria lists. Subsequently, we reduced the number of items by using the Delphi consensus technique. Each Delphi round comprised a questionnaire, an analysis, and a feedback report. The feedback report included staff team decisions made on the basis of the analysis and their justification. A total of 33 international experts agreed to participate, of whom 21 completed all questionnaires. The initial item pool of 206 items was reduced to 9 items in three Delphi rounds. The final criteria list (the Delphi list) was satisfactory to all participants. It is a starting point on the way to a minimum reference standard for RCTs on many different research topics. This list is not intended to replace, but rather to be used alongside, existing criteria lists.

A systematic review of the effects of dynamic exercise in rheumatoid arthritis

“…These criteria were modified from the Delphi list 7 , with reference to similar criteria published by Van den Ende et al 6 , Van Tulder et al 8 , and the Pedro scale. The quality criteria relating to blinding of patient and blinding of care provider were not suitable for intervention involving dynamic physical exercise and were not included in this list.…”

“…Also some studies were excluded because patients with different arthropathies were analysed together. No quality assessment criteria specific to exercise intervention in RA have been validated though the quality assessment score used in this review is a modification of the Delphi list 7 , and similar to that used in the Cochrane review. 6 It was not possible to perform a quantitative review of the outcomes of these studies because of the widely different patient characteristics, study design and outcome measures used in the different studies.…”

Evaluation of the methodological quality of systematic reviews of health status measurement instruments

“…Accepted guidelines are available to appraise the methodological quality of clinical trials (e.g., Delphi List [9]) or diagnostic studies (QUADAS [10]). Several guidelines have been developed to appraise the methodological quality of studies on measurement properties [e.g., [11][12][13].…”

A cluster randomized trial on the effect of a multifaceted intervention improved the technical quality of diabetes care by primary care physicians: The Japan Diabetes Outcome Intervention Trial‐2 (J‐DOIT2)

“…The clinical information required to evaluate the outcome measures were gathered from medical charts. The eight clinical quality indicators were selected from those used in the Diabetes Quality Improvement Project 18 and were further revised based upon consideration of updated evidence and the Japan Diabetes Society clinical practice guidelines using a modified Delphi method 19. In a modified Delphi approach, a panel of experts assesses the appropriateness of particular clinical decisions in an iterative way.…”