Problem-based learning (PBL) is increasingly being used in medical education globally, but its effectiveness in teaching remains controversial. A randomized controlled trial (RCT) is the method of choice for evaluating its effectiveness. The quality of an RCT has a significant effect on this evaluation, but to date we have not seen an assessment of the quality of RCTs for PBL. Two researchers searched MEDLINE and EMBASE for RCTs addressing PBL in medical education. The overall quality of each report was measured on a 28-point overall quality score (OQS) based on the 2010 revised Comprehensive Standards for Reporting and Testing (CONSORT) Statement.Furthermore, to study the key factors affecting OQS more effectively, a linear regression model of those factors was established using SPSS. After literature screening, 30 RCTs were eventually included and analyzed. The median OQS was 15 (range, 7-20), which meant that half of the items in the revised 2010 CONSORT statement were poorly reported in at least 40% of the RCTs analyzed. The regression model showed that the year of publication of RCTs and the impact factors of the journals in which they were published were the main factors affecting OQS. The overall quality of reporting of RCTs on PBL teaching in medical education was not satisfactory. Some RCTs were subjectively selective in reporting certain items, leading to heterogeneity in quality. It is expected that statisticians will develop new standards more suitable for evaluating RCTs related to teaching research and that editors and peer reviewers will be required to review the relevant RCTs more strictly.

No abstract

With the deepening of medical education reform, the flipped classroom has become a commonly used teaching method. Many randomized controlled trials (RCTs) have shown that flipped classroom combined with problem-based learning improves many students' abilities. It remains unclear whether the design and reports of these RCTs comply with specifications. The aim of this study was to provide a systematic assessment of the quality of RCTs investigating the effectiveness of flipped classroom teaching in medical education. Two investigators searched PUBMED and EMBASE and analyzed 15 filtered RCTs addressing flipped classroom in medical education, published between January 1, 2016 and December 31, 2021. The overall reporting quality was assessed using the overall quality score (OQS) according to the 2010 CONSORT statement. The search revealed 15 RCTs closely related to flipped classrooms. After analysis, it appeared that least half of them made no mention of half of the OQS items in the CONSORT 2010 statement. Since the flipped classroom is anemerging teaching method, all the retrieved articles were published after 2016. Furthermore, a number of issues that we considered very important were not adequately addressed in the RCT reports. Although the CONSORT 2010 statement was issued 12 years ago, the quality and content of many RCTs are not satisfactory. Our findings suggest that authors need to make more effort to meet the CONSORT statement requirements.