Medical Research Council.

Trials of digital interventions can yield extensive, in-depth usage data, yet usage analyses tend to focus on broad descriptive summaries of how an intervention has been used by the whole sample. This paper proposes a novel framework to guide systematic, fine-grained usage analyses that better enables understanding of how an intervention works, when, and for whom. The framework comprises three stages to assist in the following: (1) familiarization with the intervention and its relationship to the captured data, (2) identification of meaningful measures of usage and specifying research questions to guide systematic analyses of usage data, and (3) preparation of datasheets and consideration of available analytical methods with which to examine the data. The framework can be applied to inform data capture during the development of a digital intervention and/or in the analysis of data after the completion of an evaluation trial. We will demonstrate how the framework shaped preparation and aided efficient data capture for a digital intervention to lower transmission of cold and flu viruses in the home, as well as how it informed a systematic, in-depth analysis of usage data collected from a separate digital intervention designed to promote self-management of colds and flu. The Analyzing and Measuring Usage and Engagement Data (AMUsED) framework guides systematic and efficient in-depth usage analyses that will support standardized reporting with transparent and replicable findings. These detailed findings may also enable examination of what constitutes effective engagement with particular interventions.

BackgroundHand-washing is regarded as a potentially important behavior for preventing transmission of respiratory infection, particularly during a pandemic.ObjectiveThe objective of our study was to evaluate whether a Web-based intervention can encourage more frequent hand-washing in the home, and to examine potential mediators and moderators of outcomes, as a necessary first step before testing effects of the intervention on infection rates in the PRIMIT trial (PRimary care trial of a website based Infection control intervention to Modify Influenza-like illness and respiratory infection Transmission).MethodsIn a parallel-group pragmatic exploratory trial design, 517 nonblinded adults recruited through primary care were automatically randomly assigned to a fully automated intervention comprising 4 sessions of tailored motivational messages and self-regulation support (n = 324) or to a no-intervention control group (n = 179; ratio 2:1). Hand-washing frequency and theory of planned behavior cognitions relating to hand-washing were assessed by online questionnaires at baseline (in only half of the control participants, to permit evaluation of effects of baseline assessment on effect sizes), at 4 weeks (postintervention; all participants), and at 12 weeks.ResultsHand-washing rates in the intervention group were higher at 4 weeks than in the control group (mean 4.40, n = 285 and mean 4.04, n = 157, respectively; P < .001, Cohen d = 0.42) and remained higher at 12 weeks (mean 4.45, n = 282 and mean 4.12, n = 154, respectively; P < .001, Cohen d = 0.34). Hand-washing intentions and positive attitudes toward hand-washing increased more from baseline to 4 weeks in the intervention group than in the control group. Mediation analyses revealed positive indirect effects of the intervention on change in hand-washing via intentions (coefficient = .15, 95% confidence interval [CI], .08–.26) and attitudes (coefficient = 0.16, 95% CI, .09–.26). Moderator analyses confirmed that the intervention was similarly effective for men and women, those of higher and lower socioeconomic status, and those with higher and lower levels of perceived risk.ConclusionsThis study provides promising evidence that Web-based interventions could potentially provide an effective method of promoting hand hygiene in the home. Data were collected during the 2010 influenza pandemic, when participants in both groups had already been exposed to extensive publicity about the need for hand hygiene, suggesting that our intervention could add to existing public health campaigns. However, further research is required to determine the effects of the intervention on actual infection rates.TrialInternational Standard Randomized Controlled Trial Number (ISRCTN): 75058295; http://www.controlled-trials.com/ISRCTN75058295 (Archived by WebCite at http://www.webcitation.org/62KSbkNmm)

PRIMIT team also includes Richard Hobbs and Bill Carmen.Running head: Developing a web-based intervention using mixed methods Keywords: health promotion; internet; human influenza; qualitative research; questionnaires Word count (excluding abstract, tables, references): 4333 AbstractThis mixed methods study informed the development of our web-based intervention to reduce the risk of transmission of respiratory infections. Two qualitative studies examined 28 users' responses to website materials, and elicited additional beliefs. A questionnaire study (N =129) tested key intervention assumptions: that hand-washing is considered the most feasible preventive behaviour; behavioural determinants were related to behavioural intentions; beliefs related to hand-washing intentions and behaviour. Thematic analysis of the qualitative data revealed important issues, such as the belief that catching minor infections is beneficial to the immune system. The questionnaire results confirmed our assumptions, including handwashing as the appropriate target behaviour.

This was an exploratory pilot study forming part of a programme of work to develop and trial an effective web-based intervention to reduce the risk of transmission of respiratory infections by promoting hand-washing and other preventive behaviours in pandemic and non-pandemic contexts. The main purpose of this study was to confirm that the behavioural determinants we had identified from theory were related as predicted to intentions, and to establish the validity of our measures of behavioural intentions.Participants (N = 84) completed a self-report web-delivered questionnaire measuring intentions to engage in hand-washing and the hypothesised behavioural determinants of intentions, based on the Theory of Planned Behaviour and Protection Motivation Theory. In a factorial 2X2 design half the participants were first