Purpose
To use the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement checklist to critically evaluate the change in quality of observational trial reporting in the Journal of Hand Surgery American between 2005 and 2011.
Methods
A cross-sectional analysis of observational studies published in Journal of Hand Surgery American was designed to sample 2 6-month periods of publication (March 2005 - August 2005 and June 2011 - November 2011). Fifty-one items were extracted from the STROBE statement for evaluation. Overall STROBE compliance rates for articles and specific checklist items were determined. Final compliance percentages from each period were compared by Student t-testing. Changes in item compliance over time were quantified.
Results
Overall compliance with the STROBE statement was 38% (range, 10-54%) in 2005 and 58% (range, 39%-85%) for 2011 manuscripts representing a significant improvement. Seventy-five percent or greater of articles (2005/2011) provided the explicit reporting of background (100%/97%), follow-up time (85%/94%), overall interpretation of data (100%/94%), and results of similar studies (95%/89%). Twenty-five percent or less of articles provided the study design in the abstract (10%/20%), a clear description of the study's setting (10%/23%), the handling of missing data (0%/6%), the potential directions of bias (5%/11%) and use of a power analysis (0%/17%). Eighty-six percent (44/51) of items were more frequently satisfied in 2011 articles compared to 2005 publications. Absolute increases in compliance rates of ≥40% were noted in 10 items (20%) with no worsening in compliance for an individual item over 6%.
Discussion
The overall quality of the reporting of observational trials in Journal of Hand Surgery American improved from 2005 to 2011. Current observational trials in hand surgery could still benefit from increased reporting of methodologic details including the use of power analyses, the handling of missing data, and consideration of potential bias.