Selection Bias of Internet Panel Surveys

Tsuboi, Satoshi; Yoshida, Honami; Ae, Ryusuke; Kojo, Takao; Nakamura, Yosikazu; Kitamura, Kaori

doi:10.1177/1010539512450610

Cited by 22 publications

(9 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…One is the young median age of our responder, which is mostly due to the dissemination manner (via social media) and to their familiarity with digital technologies. The latter, also known as the "digital divide" [31], is a frequent bias affecting Internet-based surveys and cannot currently be overcome [32]. Another limitation is the skewing in the geographical distribution of responders, which were 79% from the North-East.…”

Section: Discussionmentioning

confidence: 99%

Covid-19 and the Subsequent Lockdown Modified Dietary Habits of Almost Half the Population in an Italian Sample

Scarmozzino

Visioli

2020

Foods

502

547

View full text Add to dashboard Cite

The Covid-19 pandemic led to lockdowns in several parts of the world and, hence, changed some daily habits, including social interactions, the ability to perform sports, and—possibly—diet. The Italian government established and promulgated lockdown policies on 9 March 2020. We aim at assessing the effects of Covid-19-induced confinement policies on self-reported food consumption of self-selected Italians by means of a questionnaire that was created and diffused by the Internet. Nearly half, i.e., 49.6% of responders did not substantially modify their diet during the lockdown; however, 46.1% of them reported that they were eating more during confinement, and 19.5% gained weight. In particular, we report an increase in “comfort food” consumption, notably chocolate, ice-cream, and desserts (42.5%) and salty snacks (23.5%). In addition, 42.7% percent of this cohort attributed this increase to higher anxiety levels. Related to this, 36.8% of responders reported a decrease in alcohol consumption, even though 10.1% of them reported an increase. Interestingly, 21.2% of responders increased their consumption of fresh fruit and vegetables. Only 33.5% of those who declared decreased consumption attributed this change of diet to lower availability and ease of purchasing such items. Equally interesting, over half of responders, i.e., 56.2%, admitted that fruit and vegetables did not appeal to them while in lockdown. Purchases of ready-made meals were reduced by nearly 50%. Future large-scale similar studies should be undertaken worldwide and will help public health authorities shape their reactions to future, unavoidable pandemics.

show abstract

Section: Discussionmentioning

confidence: 99%

Covid-19 and the Subsequent Lockdown Modified Dietary Habits of Almost Half the Population in an Italian Sample

Scarmozzino

Visioli

2020

Foods

502

547

View full text Add to dashboard Cite

show abstract

“…The following limitations of the study should be noted. Our use of an Internet sample for the sake of convenience may limit the generalizability of the findings, since Internet users tend to have different sociodemographic and psychological characteristics than non-users 40 , 41 ) . In addition, the present sample included a limited proportion of respondents with blue-collar jobs.…”

Section: Discussionmentioning

confidence: 99%

Construct validity and test-retest reliability of the World Mental Health Japan version of the World Health Organization Health and Work Performance Questionnaire Short Version: a preliminary study

et al. 2020

View full text Add to dashboard Cite

The aim of the study was to investigate test-retest reliability and construct validity of the World Mental Health Japan (WMHJ) version of WHO-HPQ according the COSMIN standard. We conducted two consecutive surveys of 102 full-time employees recruited through an Internet survey company in Japan, with a two-week interval in 2018. We calculated Pearson's correlation (r) of measures of the WHO-HPQ with other presenteeism scales (SPS, WFun, and perceived relative presenteeism), health and psychosocial job conditions. We tested the test-retest reliability (intraclass correlation, ICC) among those who reported no change of job performance during the follow-up. Among 92 (90%) respondents, the absolute presenteeism significantly correlated with WFun and perceived relative presenteeism (r= -0.341 and -0.343, respectively, p<0.01) and psychological distress (r=-0.247, p=0.018). The absolute/relative absenteeism did not significantly correlate with the covariates. The test-retest reliability over a two-week period was high for the WHO-HPQ absolute presenteeism (ICC, 0.73), while those for absolute/relative absenteeism measures were moderate. The study found an adequate level of test-retest reliability, but limited support for the construct validity of the absolute presenteeism measure of the WMHJ version of the WHO-HPQ. Further research is needed to investigate the construct validity of the WHO-HPQ measures in a larger sample.

show abstract

“…Although surveying on the Internet has undeniable advantages such as speed, cost, or flexibility, it may create a selection bias against people who do not have Internet access and the illiterate population [56]. Literature shows that the prevalence of women, older, and highly educated people is higher in Internet panels in comparison to that in paper-based surveys [57]. Different biases may have reduced the prevalence of vulnerable populations in the present study and led to an over-estimation of the indicators.…”

Section: Discussionmentioning

confidence: 99%

Appropriation of the Front-of-Pack Nutrition Label Nutri-Score across the French Population: Evolution of Awareness, Support, and Purchasing Behaviors between 2018 and 2019

et al. 2020

View full text Add to dashboard Cite

Since the implementation of the Nutri-Score on a voluntary basis in 2017 in France, very few studies have evaluated how the label was recognized and used by consumers. The goal of this study was to assess the evolution of awareness, support, and perceived impact on purchasing behaviors of the Nutri-Score in France. Between April 2018 and May 2019, a total of 4006 participants were recruited across three successive waves and answered questions regarding awareness of the Nutri-Score, support of the measure, and change of behavior following the implementation of the Nutri-Score via an online survey. Descriptive analyses to assess the evolution over time were performed, as well as logistic regression models to evaluate associations between the different outcomes and individual characteristics. From April 2018 to May 2019, the awareness of the Nutri-Score increased considerably, reaching 81.5% in May 2019. Since April 2018, a steady proportion of participants—9 out of 10—showed strong support toward the measure and a similar proportion, 87.2%, declared being in favor of making the Nutri-Score mandatory. The impact on purchasing behaviors appeared promising given the limited implementation of the label, with 42.9% of the participants reporting they modified their purchasing behaviors thanks to the measure. Multivariate analyses showed that the impact on purchasing behaviors of the Nutri-Score was greater over time, on younger populations and on frequent labeling readers. Our results suggested that the labeling system was well received and used by all socioeconomic groups, including subgroups who are more likely to have a lower-quality diet.

show abstract

Selection Bias of Internet Panel Surveys

Abstract: The estimated characteristics of commercial Internet panel surveys were quite different from the national statistical data. In a commercial Internet panel survey, selection bias should not be underestimated.

Cited by 22 publications

References 22 publications

Covid-19 and the Subsequent Lockdown Modified Dietary Habits of Almost Half the Population in an Italian Sample

Covid-19 and the Subsequent Lockdown Modified Dietary Habits of Almost Half the Population in an Italian Sample

Construct validity and test-retest reliability of the World Mental Health Japan version of the World Health Organization Health and Work Performance Questionnaire Short Version: a preliminary study

Appropriation of the Front-of-Pack Nutrition Label Nutri-Score across the French Population: Evolution of Awareness, Support, and Purchasing Behaviors between 2018 and 2019

Contact Info

Product

Resources

About