IntroductionThe Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within 6 domains and 2 overall assessments (1. overall guideline quality; 2. recommendation for use). The aim of this systematic review was twofold. Firstly, to investigate how often AGREE II users conduct the 2 overall assessments. Secondly, to investigate the influence of the 6 domain scores on each of the 2 overall assessments.Materials and methodsA systematic bibliographic search was conducted for publications reporting guideline appraisals with AGREE II. The impact of the 6 domain scores on the overall assessment of guideline quality was examined using a multiple linear regression model. Their impact on the recommendation for use (possible answers: “yes”, “yes, with modifications”, “no”) was examined using a multinomial regression model.Results118 relevant publications including 1453 guidelines were identified. 77.1% of the publications reported results for at least one overall assessment, but only 32.2% reported results for both overall assessments. The results of the regression analyses showed a statistically significant influence of all domains on overall guideline quality, with Domain 3 (rigour of development) having the strongest influence. For the recommendation for use, the results showed a significant influence of Domains 3 to 5 (“yes” vs. “no”) and Domains 3 and 5 (“yes, with modifications” vs. “no”).ConclusionsThe 2 overall assessments of AGREE II are underreported by guideline assessors. Domains 3 and 5 have the strongest influence on the results of the 2 overall assessments, while the other domains have a varying influence. Within a normative approach, our findings could be used as guidance for weighting individual domains in AGREE II to make the overall assessments more objective. Alternatively, a stronger content analysis of the individual domains could clarify their importance in terms of guideline quality. Moreover, AGREE II should require users to transparently present how they conducted the assessments.

No abstract

To the best of our knowledge, our findings indicate for the first time that the objective approach for the development of search strategies is noninferior to the conceptual approach.

Our findings indicate that the objective approach applied by IQWiG for search strategy development yields higher sensitivity than and similar precision to a conceptual approach. The main advantage of the objective approach is that it produces consistent results across searches.

Context Prostate‐specific antigen (PSA) testing increases prostate cancer diagnoses and reduces long‐term disease‐specific mortality, but also results in overdiagnoses and treatment‐related harms. Objective To systematically assess the benefits and harms of population‐based PSA screening and the potential net benefit to inform health policy decision‐makers in Germany. Evidence Acquisition We performed a protocol‐guided comprehensive literature search according to the Preferred Reporting Items for Systematic Reviews and Meta‐analyses (PRISMA) statement. All steps were performed by one or two investigators; any discrepancies were resolved by consensus. To allow subgroup analyses for identifying the optimal screening parameters, the eight national trials conducted under the umbrella of the European Randomised study of Screening for Prostate Cancer (ERSPC) were included as individual trials. Evidence Synthesis We included a total 11 randomised controlled trials (RCTs) with a total of 416 000 study participants. For all‐cause mortality, we found neither benefit nor harm. PSA screening was associated with a reduced risk of both prostate cancer mortality and the development of metastases. For the outcomes of health‐related quality of life, adverse effects and the consequences of false‐negative screening results there was no difference; however, this was due to the lack of eligible RCT data. Finally, PSA screening was associated with large numbers of overdiagnoses with adverse downstream consequences of unnecessary treatment (e.g. incontinence, erectile dysfunction) and large numbers of false‐positive PSA tests leading to biopsies associated with a small but not negligible risk of complications. Limitations of this assessment include the clinical heterogeneity and methodological limitations of the underlying studies. Conclusions The benefits of PSA‐based prostate cancer screening do not outweigh its harms. We failed to identify eligible screening studies of newer biomarkers, PSA derivatives or modern imaging modalities, which may alter the balance of benefit to harm. Patient Summary In the present study, we reviewed the evidence on the PSA blood test to screen men without symptoms for prostate cancer. We found that the small benefits experienced by some men do not outweigh the harms to many more men.