OBJECTIVE:The reporting of relative risk reductions (RRRs) or absolute risk reductions (ARRs) to quantify binary outcomes in trials engenders differing perceptions of therapeutic efficacy, and the merits of P values versus confidence intervals (CIs) are also controversial. We describe the manner in which numerical and statistical difference in treatment outcomes is presented in published abstracts.
DESIGN:A descriptive study of abstracts published in 1986 and 1996 in 8 general medical and specialty journals. Inclusion criteria: controlled, intervention trials with a binary primary or secondary outcome. Seven items were recorded: raw data (outcomes for each treatment arm), measure of relative difference (e.g., RRR), ARR, number needed to treat, P value, CI, and verbal statement of statistical significance. The prevalence of these items was compared between journals and across time.
RESULTS:Of 5,293 abstracts, 300 met the inclusion criteria. In 1986, 60% of abstracts did not provide both the raw data and a corresponding P value or CI, while 28% failed to do so in 1996 (P < .001; RRR of 53%; ARR of 32%; CI for ARR 21% to 43%). The variability between journals was highly significant (P < .001). In 1986, 100% of abstracts lacked a measure of absolute difference while 88% of 1996 abstracts did so (P < .001). In 1986, 98% of abstracts lacked a CI while 65% of 1996 abstracts did so (P < .001).
CONCLUSIONS:The provision of quantitative outcome and statistical quantitative information has significantly increased between 1986 and 1996. However, further progress can be made to make abstracts more informative.KEY WORDS: periodicals; abstracts; statistics; format effect; quantitative results. J GEN INTERN MED 2002;17:203±206. T he abstract has increasingly become a crucial source of information for the busy physician accessing the medical literature. 1 It is often the means by which articles to be read are selected and in cases in which the full text is unavailable, it is even the basis upon which clinical decisions are made. 2 Concern about the need for more adequate abstracts of research papers led an ad hoc working group of clinical epidemiologists and journal editors to publish guidelines 3 for structured abstracts in April, 1987. These guidelines have since been modified and refined, 4 and a particular emphasis has been placed on the presentation of study results. 5,6 Despite these efforts to improve the informative content of abstracts, the data presented in them may still lack quantitative measures of statistical significance (P value and confidence interval [CI]) and may be misinterpreted by readers due to the effect of the outcome format on the appraisal of trial results. 7 Format effects are particularly salient in the setting of a low-event rate (e.g., 2% death rate), where a large relative risk reduction (RRR) (``50% fewer deaths'') corresponds to only a small absolute risk reduction (ARR)(``1% fewer persons die'') and a large number needed to treat (NNT) (``need to treat 100 people to save 1 life''). A high RR...