Reliability and completion speed in online questionnaires under consideration of personality

Harms, Christopher; Jackel, Lina; Montag, Christian

doi:10.1016/j.paid.2017.02.015

Cited by 11 publications

(4 citation statements)

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is worth stating that the questionnaire was used as the main assessment tool in this study. The structure and entries of the questionnaire were based on previous studies by Harms (2017) and Tsai (2020) et al in which its reliability and validity in similar learning environments were verified in detail [48,49], and professors on campus helped to verify the relevance of the entries and the clarity of the representations. In order to further adapt the questionnaire to the present specific context of the study, the questionnaire was fine-tuned according to the results of the pretest, which involved 30 learners and showed statistically good internal consistency (Cronbach's α = 0.87).…”

Section: Methodsmentioning

confidence: 99%

Liaoning University ChopMelon Net Project: Innovative Research on Sustainable Education Based on Real Social Issues

Tian,

Liu,

Tang

2024

Sustainability

View full text Add to dashboard Cite

The purpose of this study is to evaluate how the ChopMelon Net online learning platform can contribute to the effectiveness of sustainable education by incorporating real social issues. The core innovation of ChopMelon Net is that it provides a learning environment that connects learners directly to real-world challenges and aims to enhance learners’ understanding of sustainable development theory. The study employed the technology acceptance model (TAM), theory of planned behavior (TPB), and knowledge–Behavior gap theory (KBGT) to design the questionnaires and semi-structured interviews in order to comprehensively assess the impact of ChopMelon Net on learners’ skill enhancement. The results showed that learners not only showed significant improvement in critical thinking and problem-solving skills after using ChopMelon Net, but also expressed a high level of satisfaction with the educational content and interactive experience provided by the platform. In addition, the study found that ChopMelon Net effectively promoted learners’ awareness of the importance of sustainable education and behavioral change through its innovative educational model, which provides important empirical support for future sustainable education practices and the design of online education platforms. This study highlights the importance and effectiveness of incorporating real social issues into the teaching and learning process, with far-reaching implications for sustainable innovation in education.

show abstract

Section: Methodsmentioning

confidence: 99%

Liaoning University ChopMelon Net Project: Innovative Research on Sustainable Education Based on Real Social Issues

Tian,

Liu,

Tang

2024

Sustainability

View full text Add to dashboard Cite

show abstract

“…We incorporate controls for two alternative explanations. Although there is mixed evidence in the effect of personality traits on response latency (Harms, Jackel, and Montag 2017), we control in all models for the respondent’s need for cognition, with the expectation that respondents high in need for cognition will be more reluctant to answer DK and thus employ more time to answer. In addition, we control for the total duration of the survey for each respondent, as a proxy of the respondent’s general speed.…”

Section: Methodsmentioning

confidence: 99%

How long does it take to admit that you do not know? Gender differences in response time to political knowledge questions

Ferrín

García-Albacete

Sánchez-Vítores

2022

Research & Politics

View full text Add to dashboard Cite

The implications of the persistent gender gap in political knowledge are a puzzle that the literature is still disentangling; and research has evidenced important differences in the way women and men respond to survey questions. We argue in this article that political knowledge survey items not only inform about differences in cognition but also about other latent traits related to gender stereotyping. Gender stereotypes around political knowledge push men to be knowledgeable but not so much women, which we expect to affect men and women’s survey responses differently. To test this expectation, we explore response times of do not know answers to political knowledge items. Our results show that men, particularly those who declare being interested in politics, take longer than women to admit that they do not know the answer to political knowledge items.

show abstract

“…We calculated response time as the difference between the time that the first page of the survey was loaded (i.e., when participants completed the instructions and consent page) and the time that participants clicked submit on the last page of the survey. Previous researchers have suggested that IER occurs when a participant's completion time is two standard deviations above or below the survey's mean completion time (e.g., Heerwegh, 2003); is 1.5 interquartile ranges lower than the first quartile or higher than the third quartile (e.g., Funke, 2016); is lower than the first percentile (e.g., Gummer & Roßmann, 2015); or is lower than the fifth percentile (e.g., Harms et al, 2017). To create our conservative cutoff and ensure we had at least 100 IER participants for our analyses (VanVoorhis & Morgan, 2007), we identified participants who were one standard deviation below the mean completion time as having responded too quickly (response time-short; n = 118, 18.90%) and one standard deviation above the mean completion time having responded too slowly (response time-long; n = 143, 22.90%).…”

Section: Reactive Indicesmentioning

confidence: 99%

Predicting insufficient effort responding: The relation between negative thoughts, emotions, and online survey responses.

Ashley¹,

Shaughnessy²

2023

Canadian Journal of Behavioural Science / Revue canadienne des

View full text Add to dashboard Cite

Online surveys are a popular source of data collection across organizations and academic settings. Insufficient effort responding (IER) to surveys occurs when participants fail to carefully read survey instructions or item content. Researchers commonly analyze IER as a methodological nuisance. The purpose of this article is to examine the extent to which negative emotions and thoughts predict proactive and reactive IER indicators. A sample of 625 participants completed an online survey containing a background questionnaire, the agreeableness and conscientiousness subscales of the Mini-International Personality Item Pool, the intrinsic motivation subscale of the Situational Motivational Scale, the Boredom Proneness Scale, and three proactive and six reactive IER indices. Binary logistic regression analysis results showed participants who experienced higher levels of state anxiety, distress, and sadness while completing the survey were more likely to not pay attention and/or violate test instructions. Participants who indicated they regretted agreeing to participate in the survey, were more likely to not pay attention, respond dishonestly, respond too quickly, and/or self-report that they had exerted little effort and attention. These findings suggest that IER behaviors are, in part, a manifestation of participants' negative emotions and thoughts. Public Significance StatementInsufficient effort responding (IER) can be considered a subtle avoidance behavior in response to negative emotions and thoughts experienced during survey completion. This idea was supported by the results of this study, which showed that participants who reported greater negative emotions and thoughts were more likely to not pay attention, ignore test instructions, respond dishonestly, respond too quickly, and self-report they exerted little effort and attention when completing an online study.

show abstract

Reliability and completion speed in online questionnaires under consideration of personality

Cited by 11 publications

References 55 publications

Liaoning University ChopMelon Net Project: Innovative Research on Sustainable Education Based on Real Social Issues

Liaoning University ChopMelon Net Project: Innovative Research on Sustainable Education Based on Real Social Issues

How long does it take to admit that you do not know? Gender differences in response time to political knowledge questions

Predicting insufficient effort responding: The relation between negative thoughts, emotions, and online survey responses.

Contact Info

Product

Resources

About