Background There is little consensus regarding effective digital health interventions for diverse populations, which is due in part to the difficulty of quantifying the impact of various media and content and the lack of consensus on evaluating dosage and outcomes. In particular, digital smoking behavior change intervention is an area where consistency of measurement has been a challenge because of emerging products and rapid policy changes. This study reviewed the contents and outcomes of digital smoking interventions and the consistency of reporting to inform future research. Objective This study aims to systematically review digital smoking behavior change interventions and evaluate the consistency in measuring and reporting intervention contents, channels, and dose and response outcomes. Methods PubMed, Embase, Scopus, PsycINFO, and PAIS databases were used to search the literature between January and May 2021. General and journal-based searches were combined. All records were imported into Covidence systematic review software (Veritas Health Innovation) and duplicates were removed. Titles and abstracts were screened by 4 trained reviewers to identify eligible full-text literature. The data synthesis scheme was designed based on the concept that exposure to digital interventions can be divided into intended doses that were planned by the intervention and enacted doses that were completed by participants. The intended dose comprised the frequency and length of the interventions, and the enacted dose was assessed as the engagement. Response measures were assessed for behaviors, intentions, and psychosocial outcomes. Measurements of the dose-response relationship were reviewed for all studies. Results A total of 2916 articles were identified through a database search. Of these 2916 articles, the title and abstract review yielded 324 (11.11%) articles for possible eligibility, and 19 (0.65%) articles on digital smoking behavior change interventions were ultimately included for data extraction and synthesis. The analysis revealed a lack of prevention studies (0/19, 0%) and dose-response studies (3/19, 16%). Of the 19 studies, 6 (32%) reported multiple behavioral measures, and 5 (23%) reported multiple psychosocial measures as outcomes. For dosage measures, 37% (7/19) of studies used frequency of exposure, and 21% (4/19) of studies mentioned the length of exposure. The assessment of clarity of reporting revealed that the duration of intervention and data collection tended to be reported vaguely in the literature. Conclusions This review revealed a lack of studies assessing the effects of digital media interventions on smoking outcomes. Data synthesis showed that measurement and reporting were inconsistent across studies, illustrating current challenges in this field. Although most studies focused on reporting outcomes, the measurement of exposure, including intended and enacted doses, was unclear in a large proportion of studies. Clear and consistent reporting of both outcomes and exposures is needed to develop further evidence in intervention research on digital smoking behavior change.

Background Mass media campaigns for preventive health messaging have been shown to be effective through years of research. However, few studies have assessed the effectiveness of campaigns on digital media, which is currently how youths and young adults are primarily consuming media. In particular, a platform that can accurately assess exposure to digital messaging in a real-life setting has yet to be developed. Objective This study examines the feasibility of a unique survey platform, Virtual Lab, to conduct a study on exposure to a media campaign within Facebook using a chatbot-style survey administration technique. Methods Virtual Lab is a survey platform that was used to recruit and survey participants within Facebook and Facebook Messenger, respectively. We created a Facebook business account with 2 Facebook pages: one for recruitment and disseminating the survey and the other one for serving the target advertisements. Pre- and postexposure surveys were administered via Facebook Messenger using a chatbot-style questionnaire 1 week apart. During this time, the target advertisements were shown to participants who completed the pre-exposure survey. The total time from recruitment to completion of the postexposure survey was 13 days, and incentive costs were US $10 per participant. Survey data were compared between those who completed both pre- and postexposure surveys and those who only completed the pre-exposure survey; that is, those who were lost to follow-up. The demographics of the complete cases were also compared to the US census data. Results A total of 375 Facebook users aged between 18 and 24 years met eligibility requirements and consented to the study, which consisted of complete cases (n=234) and participants lost to follow-up (n=141). A few differences between complete cases and participants lost to follow-up were observed. Regarding gender, complete cases comprised 40.2% males and 59.4% females, and among participants lost to follow-up, 44.0% were male and 50.4% were female (P=.003). Differences were also observed for e-cigarette use status, where a greater number of current users and fewer past and never users were lost to follow-up than complete cases (P=.01). Conclusions The use of Virtual Lab yielded a diverse sample quickly and cost-effectively. Demographic characteristics of participants who completed the study and those who were lost to follow-up were similar, indicating that no biases were caused by the platform during recruitment or testing. This study suggests the feasibility of the Virtual Lab survey platform for studies of media campaign exposure within Facebook. This platform can advance health campaign research by providing more accurate data to inform digital messaging.

Background E-cigarettes are the most-commonly used tobacco product by youth since 2014. To prevent youth access and use of e-cigarettes, many U.S. states and localities have enacted policies over a relatively short period of time. The adoption of these policies has necessitated timely data collection to evaluate impacts. Methods To assess the impact of flavored e-cigarette policies in select states and local jurisdictions across the United States, a multi-method, complementary approach was implemented from July 2019 to present, which includes analyses of cross-sectional online surveys of young people ages 13–24 years with retail sales data. Results From February 2020 through February 2023, cross-sectional surveys have been conducted in three cities, one county, and eight states where policy changes have been enacted or are likely to be enacted. Data collection occurred every six months to provide near real-time data and examine trends over time. Additionally, weekly retail sales data were aggregated to showcase monthly sales trends at the national level and for the selected states. Discussion This rapid and efficient method of coupling online survey data with retail sales data provides a timely and effective approach for monitoring a quickly changing tobacco product landscape, particularly for states and localities where rapidly-available data is often not available. This approach can also be used to monitor other health behaviors and relevant policy impacts.

Introduction The rapid increase in online public education campaigns underscores the need for a better understanding of the effects of exposure to digital advertising and targeted individual-level outcomes. The goal of this study is to develop a virtual experimental protocol to evaluate the dose-response effects of individual-level exposure to digital video ads on campaign outcomes in a naturalistic online browsing context. Methods Young adults aged 18–24 years ( n = 221) completed three 5 min viewing sessions on a realistic mock-up of the YouTube mobile app over a period of 2 weeks, followed by a 10-min survey after the third session. Participants were randomized to view between 0 and 6 exposures of ads from an e-cigarette prevention campaign; respondents viewed a total of 2 ads per session, with 0 to 2 of those ads being non-skippable digital video ads from the campaign and/or a dummy ad. The video ads played prior to short YouTube videos. Outcomes measured were self-reported ad recognition, frequency of ad exposure, and main message knowledge. Results This study demonstrates a rapidly accessible virtual experimental protocol for evaluating the dose-response effects of digital advertising and individual-level outcomes. Five digital exposures of non-skippable video ads delivered via this platform over a 2-week period generated the highest ad recognition when there were up to six exposures. Higher exposure levels may be needed for message knowledge and ad-content-related effects. Conclusion This protocol can be extended to investigate dose-response effects and mechanisms of action of individual-level exposure to digital advertising for multiple campaign outcomes, including changes in knowledge, attitudes, and beliefs. Findings can inform evidence for adequate levels of digital exposure in public education campaigns.

BACKGROUND There is little consensus regarding effective interventions for diverse populations. This is due to the difficulty of quantifying digital health interventions that use various media and content, and the lack of consensus on how to evaluate and report dose and outcomes. One of the most rapidly changing areas is digital smoking behavior change intervention and reviewing the contents and outcomes of digital interventions and consistency of reporting leads to informing future research. OBJECTIVE This paper aims to 1) systematically review the current practice of digital smoking behavior change interventions, and 2) evaluate the consistency in measuring and reporting intervention contents, channels, and dose and response outcomes in this field. METHODS PubMed, Embase, Scopus, Psych INFO, and PAIS were used to search literature. General search and journal-based search were combined to find literature that was directly related to the scope of the study. All records were imported to COVIDENCE, a screening tool designed for systematic reviews, and duplicates were removed. Titles and abstracts were screened by four trained reviewers to determine eligible full-text literature. The data synthesis scheme was designed under the concept that exposure to digital interventions can be divided into 1) intended doses that were planned by the intervention, and 2) enacted doses that were completed by participants. The intended dose consisted of frequency and lengths of interventions, and the enacted dose was assessed as engagement. Response measures were assessed for behaviors, intentions, and psychosocial outcomes. Measurement of dose-response relationship was reviewed for all literature. RESULTS A total of 2,916 articles were identified through a database search. Title and abstract review yielded 324 articles for possible eligibility, and 19 articles on digital smoking behavior change interventions were ultimately included for data extraction and synthesis. The analysis revealed the lack of prevention studies (0%, 0/19) and dose-response studies (16%, 3/19) in this field. 6 studies (32%, 6/19) reported multiple behavioral measures and 5 studies (23%, 5/19) reported multiple psychosocial measures as outcomes. As dose measures, 7 studies (37%, 7/19) used frequency of exposure, and 4 studies (21%, 4/19) mentioned the length of exposure to the intervention. The assessment of clarity of reporting revealed that duration of intervention and data collection tend to be reported vaguely in literature. CONCLUSIONS This review revealed the lack of studies that assess targeted behavioral outcomes. Data synthesis showed that both measurement and reporting were not consistent across studies, illustrating current challenges in this field. Although most studies paid attention to reporting outcomes, measurement of exposure including intended and enacted doses was unclear in a large proportion of studies. Clear and consistent reporting of both outcomes and exposures is needed to develop further evidence in digital smoking behavior change intervention research. CLINICALTRIAL N/A