Recognizing and Preventing Participant Deception in Online Nicotine and Tobacco Research Studies: Suggested Tactics and a Call to Action

Heffner, Jaimee L.; Watson, Noreen L; Dahne, Jennifer; Croghan, Ivana T.; Kelly, Megan M.; McClure, Jennifer B.; Bars, Matthew P; Thrul, Johannes; Meier, Eric

doi:10.1093/ntr/ntab077

Cited by 34 publications

(31 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A potential limitation of our study to consider that it was based on an online survey. Despite implementing quality assurance measures, both in survey design (such as attention check questions [ 30 ]), IP address novelty checks, geolocation validation, use of CAPTCHA questions, manual qualitative validation of open-ended screener questions [ 29 ], and data cleaning (such as logic checks and minimum response standards [ 31 ]), there remains a possibility of misrepresentation by participants of their eligibility. However, due to both the necessary sample size needed to compare categorizations of as many favorite flavor responses as possible and the COVID-19 pandemic, which happened during data collection, in-person data collection methods were not possible.…”

Section: Discussionmentioning

confidence: 99%

“…Of those invited, 1037 participants began the survey, and 844 completed it. Quality control measures included removal of responses with duplicate IP addresses, surveys determined to be outside of the U.S., or respondents who missed more than two of the three attention check questions [ 29 , 30 ]. Participants who completed the survey and correctly answered the attention check questions received a USD 15 e-gift card.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Dissonance in Young Adult Cigarillo Users’ Categorization of Concept Flavored and Unflavored Products

Osborn

Suratkal

Moore

et al. 2022

IJERPH

View full text Add to dashboard Cite

This study asks young adult cigarillo users to categorize their preferred flavor in order to examine user consensus and potential methodological and regulatory implications of flavor name-based categorization systems. Young adult (21–28 years) cigarillo users (n = 426) named and categorized their favorite cigarillo flavor into one of seven categories: Fruit, Sweet and Candy, Mint, Alcohol, Menthol, Tobacco, and Other. Flavor responses were coded as characterizing (ex: Grape, Wine) or concept (ex: Jazz, Diamond) flavors. Variation within and between categories was assessed, including the presence of concept flavors and the placement of flavors in multiple categories. Of the 66 unique flavor names provided, participants placed 20 (30.1%) in more than one flavor category. Most of the Tobacco (76.9%) and Other (69.2%) flavor names appeared in multiple categories. The majority of flavor names in the Tobacco (69.2%) and Other (61.5%) categories were concept flavors. Concept flavors were placed in multiple categories (45.0%) twice as often as characterizing flavors (23.9%). This study has identified dissonance among cigarillo users’ flavor categorizations, particularly for concept flavored and unflavored products. Flavor names may obscure how and whether a product is flavored. Research on and regulation of flavored tobacco products should classify products by flavor additives rather than by name alone.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Dissonance in Young Adult Cigarillo Users’ Categorization of Concept Flavored and Unflavored Products

Osborn

Suratkal

Moore

et al. 2022

IJERPH

View full text Add to dashboard Cite

show abstract

“…Following these automatic eligibility checks ( n = 753), a total of 436 participants completed the survey (completion rate of 58%). Based on proposed guidance for online recruitment quality review by Heffner et al (2021) , potential participants were removed if three of the following four previously identified quality-review criteria were met: (1) self-reported veteran status was deemed impossible when reviewed in conjunction with age, reported military service era, and/or DD214 date, (2) attention check items showed participants reporting gibberish responses to open-ended questions, (3) total time spent on the survey was under 1/3 of median completion time (< 10 min), and (4) response patterns flagged by the Qualtrics system as potential bots using their quality check software (i.e., IP-based “Prevent Ballot Box Stuffing” option, attempts to take the survey multiple times) were reviewed and found to be suspicious (e.g., answering all survey items as the last Likert scale option). A total of 27 (6.2%) potential participants were removed because they did not meet these criteria.…”

Section: Methodsmentioning

confidence: 99%

The Impact of COVID-19 on Self-Reported Substance Use, Well-Being, and Functioning Among United States Veterans: A Cross-Sectional Study

et al. 2022

View full text Add to dashboard Cite

As the COVID-19 pandemic sweeps the globe, many veterans with substance use issues have faced the closure of treatment facilities, mandates to shelter in place, and social distancing measures. To better understand their pandemic experiences, substance use changes, and functioning, a survey was nationally administered to a sample of United States veterans reporting substance use issues during the pandemic. The purpose of this cross-sectional online survey for veterans (N = 409) was to report on COVID-19 experiences, safety behaviors, and infection experiences while also investigating the relationship among addictive behaviors, mental and physical health, and COVID-19 impact. Measures also assessed specific substance use concerns, pandemic-related loneliness, and functioning. Though few veterans reported personally receiving a confirmed COVID-19 medical diagnosis (10.5%), the impact of pandemic stressors was evident, with a majority reporting anxiety related to contracting COVID-19 (61.4%) or fear of a family member or close friend contracting COVID-19 (58.7%). Participants reported increased use of alcohol (45.3%), sedatives (36.6%), inhalants (35.7%), tobacco (35.0%), and cannabis (34.9%), attributed specifically to the pandemic. Regression analyses revealed that even when controlling for the contribution of problematic substance use issues, negative pandemic impacts and self-reported COVID-19 related loneliness were related to more impaired physical and mental health functioning during the pandemic. Findings from this sample of veterans with addiction issues add to the growing literature suggesting unique and adverse effects of COVID-19 stressors on functioning while also revealing specific pandemic impacts for this group.

show abstract

“…Godinho et al offered suggestions, such as collecting contact information or embedding a Completely Automated Public Turing test to tell Computers and Humans Apart (CAPTCHA), to prevent duplicate participants or automatic survey taking bots from attempting to enroll or participate in a substance use study [49]. Researchers also recommended using a lottery system for participant remuneration, if allowed by the Institutional Review Board [50,51 ▪▪ ]. Pratt-Chapman et al pointed out that some measures to improve data integrity may dissuade eligible individuals from participation [52].…”

Section: Recruiting Underrepresented Populations Via Social Media And...mentioning

confidence: 99%

Virtual recruitment and participant engagement for substance use research during a pandemic

Hoeflich¹,

Otufowora

Cottler³

et al. 2022

Current Opinion in Psychiatry

View full text Add to dashboard Cite

Purpose of reviewThe coronavirus disease 2019 pandemic resulted in cataclysmic changes to the research enterprise, causing a forced shutdown or rapid pivot to virtual methods. Adapting studies to the virtual environment also impacted recruitment and retention strategies. This review elucidated challenges and offered pragmatic recommendations, drawing on published literature and our prior work, to assist researchers in re-evaluating and amending best-practice techniques to bolster inclusive recruitment and study engagement of people using substances, particularly for virtual interviews or focus groups. Recent findingsAmeliorating recruitment strategies and research protocols to better fit virtual methods of recruitment and study administration required careful consideration of ethical and logistical implications. Many procedures to increase enrollment of underrepresented populations, such as building mutually beneficial and respectful community partnerships, recruiting via social media, or providing ambulatory research centers, existed prior to this specific pandemic. However, unprecedented disruptions in resources needed to participate in virtual interviews or focus groups, privacy concerns, and possible deteriorating trust in research necessitated continued adaptation and expansion of these strategies.

show abstract

Recognizing and Preventing Participant Deception in Online Nicotine and Tobacco Research Studies: Suggested Tactics and a Call to Action

Cited by 34 publications

References 14 publications

Dissonance in Young Adult Cigarillo Users’ Categorization of Concept Flavored and Unflavored Products

Dissonance in Young Adult Cigarillo Users’ Categorization of Concept Flavored and Unflavored Products

The Impact of COVID-19 on Self-Reported Substance Use, Well-Being, and Functioning Among United States Veterans: A Cross-Sectional Study

Virtual recruitment and participant engagement for substance use research during a pandemic

Contact Info

Product

Resources

About