Social media use was nearly universal in the surveyed cohort. Posting of unprofessional content was highly prevalent despite understanding that this might be considered inappropriate, and despite awareness of professionalism guidelines. Medical educators should consider approaches to this problem that involve more than simply providing guidelines or policies, and students should be regularly prompted to evaluate and moderate their own online behaviour.
Summary
Are the results of randomised trials reliable and are p values and confidence intervals the best way of quantifying efficacy? Low power is common in medical research, which reduces the probability of obtaining a ‘significant result’ and declaring the intervention had an effect. Metrics derived from Bayesian methods may provide an insight into trial data unavailable from p values and confidence intervals. We did a structured review of multicentre trials in anaesthesia that were published in the New England Journal of Medicine, The Lancet, Journal of the American Medical Association, British Journal of Anaesthesia and Anesthesiology between February 2011 and November 2021. We documented whether trials declared a non‐zero effect by an intervention on the primary outcome. We documented the expected and observed effect sizes. We calculated a Bayes factor from the published trial data indicating the probability of the data under the null hypothesis of zero effect relative to the alternative hypothesis of a non‐zero effect. We used the Bayes factor to calculate the post‐test probability of zero effect for the intervention (having assumed 50% belief in zero effect before the trial). We contacted all authors to estimate the costs of running the trials. The median (IQR [range]) hypothesised and observed absolute effect sizes were 7% (3–13% [0–25%]) vs. 2% (1–7% [0–24%]), respectively. Non‐zero effects were declared for 12/56 outcomes (21%). The Bayes factor favouring a zero effect relative to a non‐zero effect for these 12 trials was 0.000001–1.9, with post‐test zero effect probabilities for the intervention of 0.0001–65%. The other 44 trials did not declare non‐zero effects, with Bayes factors favouring zero effect of 1–688, and post‐test probabilities of zero effect of 53–99%. The median (IQR [range]) study costs reported by 20 corresponding authors in US$ were $1,425,669 ($514,766–$2,526,807 [$120,758–$24,763,921]). We think that inadequate power and mortality as an outcome are why few trials declared non‐zero effects. Bayes factors and post‐test probabilities provide a useful insight into trial results, particularly when p values approximate the significance threshold.
Background: To evaluate the methodological quality of (1) clinical practice guidelines (CPGs) that inform nutrition care in critically ill adults using the AGREE II tool and (2) CPG recommendations for determining energy expenditure using the AGREE-REX tool. Methods: CPGs by a professional society or academic group, intended to guide nutrition care in critically ill adults, that used a systematic literature search and rated the evidence were included. Four databases and grey literature were searched from January 2011 to 19 January 2022. Five investigators assessed the methodological quality of CPGs and recommendations specific to energy expenditure determination. Scaled domain scores were calculated for AGREE II and a scaled total score for AGREE-REX. Data are presented as medians (interquartile range). Results: Eleven CPGs were included. Highest scoring domains for AGREE II were clarity of presentation (82% [76–87%]) and scope and purpose (78% [66–83%]). Lowest scoring domains were applicability (37% [32–42%]) and stakeholder involvement (46% [33–51%]). Eight (73%) CPGs provided recommendations relating to energy expenditure determination; scores were low overall (37% [36–40%]) and across individual domains. Conclusions: Nutrition CPGs for critically ill patients are developed using systematic methods but lack engagement with key stakeholders and guidance to support application. The quality of energy expenditure determination recommendations is low.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.