Health surveys are an important resource for monitoring population health, but selective nonresponse may impede valid inference. This study aimed to assess nonresponse bias in a population-sampled health survey in Scotland, with a focus on alcohol-related outcomes. Nonresponse bias was assessed by examining whether rates of alcohol-related harm (i.e., hospitalization or death) and all-cause mortality among respondents to the Scottish Health Surveys (from 1995 to 2010) were equivalent to those in the general population, and whether the extent of any bias varied according to sociodemographic attributes or over time. Data from consenting respondents (aged 20–64 years) to 6 Scottish Health Surveys were confidentially linked to death and hospitalization records and compared with general population counterparts. Directly age-standardized incidence rates of alcohol-related harm and all-cause mortality were lower among Scottish Health Survey respondents compared with the general population. For all years combined, the survey-to-population rate ratios were 0.69 (95% confidence interval: 0.61, 0.76) for the incidence of alcohol-related harm and 0.89 (95% confidence interval: 0.83, 0.96) for all-cause mortality. Bias was more pronounced among persons residing in more deprived areas; limited evidence was found for regional or temporal variation. This suggests that corresponding underestimation of population rates of alcohol consumption is likely to be socially patterned.

IntroductionReliable estimates of health-related behaviours, such as levels of alcohol consumption in the population, are required to formulate and evaluate policies. National surveys provide such data; validity depends on generalisability, but this is threatened by declining response levels. Attempts to address bias arising from non-response are typically limited to survey weights based on sociodemographic characteristics, which do not capture differential health and related behaviours within categories. This project aims to explore and address non-response bias in health surveys with a focus on alcohol consumption.Methods and analysisThe Scottish Health Surveys (SHeS) aim to provide estimates representative of the Scottish population living in private households. Survey data of consenting participants (92% of the achieved sample) have been record-linked to routine hospital admission (Scottish Morbidity Records (SMR)) and mortality (from National Records of Scotland (NRS)) data for surveys conducted in 1995, 1998, 2003, 2008, 2009 and 2010 (total adult sample size around 40 000), with maximum follow-up of 16 years. Also available are census information and SMR/NRS data for the general population. Comparisons of alcohol-related mortality and hospital admission rates in the linked SHeS-SMR/NRS with those in the general population will be made. Survey data will be augmented by quantification of differences to refine alcohol consumption estimates through the application of multiple imputation or inverse probability weighting. The resulting corrected estimates of population alcohol consumption will enable superior policy evaluation. An advanced weighting procedure will be developed for wider use.Ethics and disseminationEthics approval for SHeS has been given by the National Health Service (NHS) Multi-Centre Research Ethics Committee and use of linked data has been approved by the Privacy Advisory Committee to the Board of NHS National Services Scotland and Registrar General. Funding has been granted by the MRC. The outputs will include four or five public health and statistical methodological international journal and conference papers.Primary subject headingPublic health.Secondary subject headingAddiction: health policy; mental health.

Background and aimsAnalytical approaches to addressing survey non‐participation bias typically use only demographic information to improve estimates. We applied a novel methodology which uses health information from data linkage to adjust for non‐representativeness. We illustrate the method by presenting adjusted alcohol consumption estimates for Scotland.DesignData on consenting respondents to the Scottish Health Surveys (SHeSs) 1995–2010 were linked confidentially to routinely collected hospital admission and mortality records. Synthetic observations representing non‐respondents were created using general population data. Multiple imputation was performed to compute adjusted alcohol estimates given a range of assumptions about the missing data. Adjusted estimates of mean weekly consumption were additionally calibrated to per‐capita alcohol sales data.SettingScotland.Participants13 936 male and 18 021 female respondents to the SHeSs 1995–2010, aged 20–64 years.MeasurementsWeekly alcohol consumption, non‐, binge‐ and problem‐drinking.FindingsInitial adjustment for non‐response resulted in estimates of mean weekly consumption that were elevated by up to 17.8% [26.5 units (18.6–34.4)] compared with corrections based solely on socio‐demographic data [22.5 (17.7–27.3)]; other drinking behaviour estimates were little changed. Under more extreme assumptions the overall difference was up to 53%, and calibrating to sales estimates resulted in up to 88% difference. Increases were especially pronounced among males in deprived areas.ConclusionsThe use of routinely collected health data to reduce bias arising from survey non‐response resulted in higher alcohol consumption estimates among working‐age males in Scotland, with less impact for females. This new method of bias reduction can be generalized to other surveys to improve estimates of alternative harmful behaviours.