Quality of randomized controlled trials of new generation antidepressants and antipsychotics identified in the China National Knowledge Infrastructure (CNKI): a literature and telephone interview study

Abstract

BackgroundWe are witnessing an exponential increase in the number of randomized controlled trials (RCTs) reported from mainland China. The increase is particularly notable in the field of new generation antidepressants and antipsychotics. Several previous studies have raised doubts regarding their quality. However, the quality of most recent RCTs published in China may have improved.MethodsWe searched RCTs that examined new generation antidepressants and antipsychotics published between 2013 and 2016 in the China National Knowledge Infrastructure (CNKI), the largest database of scientific publications in China. We interviewed the authors of a random subset of the identified references. We assessed the methodological rigor of each study based on the published reports and telephone interviews with the authors using six methodological domains adapted from the Cochrane’s risk of bias tool.ResultsThe final sample consisted of 138 studies, for which we interviewed 58 authors; the authors of 51 studies declined the interview, and the authors of 29 studies could not be contacted. The 51 studies with refused interviews were significantly less likely to be reported from university-affiliated hospitals and were less likely to be published in Chinese core journals. Based on the published reports, most of the 58 studies were assessed to be at unclear risk of bias in most methodological domains. After the interview, only 10 studies were assessed to be at low risk of bias for sequence generation and allocation concealment. Assuming that the studies for which the authors declined interviews had an unclear risk, the proportion of RCTs at low risk of bias in both sequence generation and allocation concealment was 9.2% (10/109, 95% confidence interval [CI]: 5.0 to 16.2). The interviews indicated that the studies were at high risk of bias for most of the other domains.ConclusionIn general, RCTs that evaluate new generation antidepressants or antipsychotics and are indexed in the CNKI continue to be of low quality. When conducting systematic reviews and meta-analyses in this field, it would be wise to include a specialist from China as a coresearcher to help assess the risk of bias in the identified studies.Electronic supplementary materialThe online version of this article (10.1186/s12874-018-0554-2) contains supplementary material, which is available to authorized users.

Comparative efficacy and tolerability of 32 oral antipsychotics for the acute treatment of adults with multi-episode schizophrenia: a systematic review and network meta-analysis

“…Studies with a high risk of bias in sequence generation or allocation concealment according to the Cochrane Collaboration's risk of bias tool were excluded 11 . We a-priori excluded studies from mainland China owing to quality concerns 14 . We searched MEDLINE, Cochrane Central Register of Controlled Trials (CENTRAL), Embase, Biosis, PsycINFO, PubMed, ClinicalTrials.gov, WHO International Clinical Trials Registry Platform and the US Food and Drug Administration website without language restrictions from database inception until Jan 8, 2019.…”

Comparative Efficacy and Tolerability of 32 Oral Antipsychotics for the Acute Treatment of Adults With Multi-Episode Schizophrenia: A Systematic Review and Network Meta-Analysis

“…11 We a-priori excluded studies from mainland China owing to quality concerns. 14 We searched MEDLINE, Cochrane Central Register of Controlled Trials (CENTRAL), Embase, Biosis, PsycINFO, PubMed, ClinicalTrials.gov, WHO International Clinical Trials Registry Platform and the US Food and Drug Administration website without language restrictions from database inception until Jan 8, 2019. The search strategy combined terms for schizophrenia or psychosis and various drug names (appendix pp .…”

Comparative efficacy and acceptability of antidepressants in the long-term treatment of major depression: protocol for a systematic review and networkmeta-analysis

“…It has been under debate whether Chinese databases should be searched when conducting a systematic review 25. Moreover, recent studies have shown that the trials indexed in Chinese databases generally suffer from numerous quality issues,24 and evaluating their credibility and integrity is beyond the scope of this work 25. We therefore decided to exclude such studies to avoid any potential bias that might arise by their inclusion.…”