Crowdsourcing in Computing Education Research: Case Amazon MTurk

Hellas, Arto; Zavgorodniaia, Albina; Sorva, Juha

doi:10.1145/3428029.3428062

Cited by 9 publications

(6 citation statements)

References 31 publications

(47 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…MTurk has been found to be a unique and robust source of human intelligence services, including survey completion in educational contexts (Follmer et al, 2017). Several recent studies in education focused on financial aid jargon (Taylor & Bicak, 2019) and computer science education (Hellas et al, 2020) have used MTurk to answer research questions that require a large, nationally representative dataset, akin to the study at hand related to postsecondary student attitudes toward COVID-19 vaccinations.…”

Section: Methodsmentioning

confidence: 99%

Measuring College Student Attitudes Toward COVID-19 Vaccinations

Taylor

Bicak

Childs

et al. 2021

Preprint

View full text Add to dashboard Cite

This survey explores attitudes of 1,197 currently enrolled college students regarding their comfort taking a COVID-19 vaccine. Results suggest most college students are willing to take a COVID-19 vaccine if their institution requires it to return to campus in subsequent semesters. However, certain students of Color, students with disabilities, and adult students may be less willing to take a COVID-19 vaccine if it were required before or during an on-campus semester. Finally, many college students do not understand that COVID-19 vaccines will be free, possibly affecting these students’ willingness to vaccinate and their perceptions of safely and affordably returning to campus. Implications for postsecondary policy and leadership are addressed.

show abstract

Section: Methodsmentioning

confidence: 99%

Measuring College Student Attitudes Toward COVID-19 Vaccinations

Taylor

Bicak

Childs

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…MTurk has been found to be a unique and robust source of human intelligence services, including survey completion in educational contexts (Follmer et al, 2017). Several recent studies in education focused on financial aid jargon (Authors, 2019) and computer science education (Hellas et al, 2020) have used MTurk to answer research questions that require a large, nationally representative dataset, akin to the study at hand related to postsecondary student attitudes toward COVID-19 vaccinations. Overall, this study's survey sample was entirely recruited from the MTurk system, representing both a limitation and a strength of this study, which will be addressed later.…”

Section: Methodsmentioning

confidence: 99%

Measuring College Student Attitudes Toward COVID-19 Vaccinations

Taylor¹,

Bicak²,

Childs³

et al. 2022

AJHS

View full text Add to dashboard Cite

This survey explores attitudes of 1,197 currently enrolled college students regarding their comfort taking a COVID-19 vaccine. Results suggest most college students are willing to take a COVID-19 vaccine if their institution requires it to return to campus in subsequent semesters. However, certain students of Color, students with disabilities, and adult students may be hesitant to take a COVID-19 vaccine if it were required before or during an on-campus semester. Finally, many college students do not understand that COVID-19 vaccines will be free, possibly affecting these students’ vaccine hesitancy and willingness to vaccinate, along with their perceptions of safely and affordably returning to campus. Implications for postsecondary policy and leadership are addressed.

show abstract

“…Although paid crowdsourcing has been used within computing education research (see e.g. [31]- [36]), data quality has not received significant attention [33]. The concerns about data quality apply equally to learnersourcing contexts where students are not paid; this is a common instructor concern that we look to address in the lessons we synthesize in the current work.…”

Section: Known Challengesmentioning

confidence: 99%

Lessons Learned From Four Computing Education Crowdsourcing Systems

et al. 2023

Self Cite

View full text Add to dashboard Cite

Crowdsourcing is a general term that describes the practice of many individuals working collectively to achieve a common goal or complete a task, often involving the generation of content. In an educational context, crowdsourcing of learning materials -where students create resources that can be used by other learners -offers several benefits. Students benefit from the act of producing resources as well as from using the resources. Despite benefits, instructors may be hesitant to adopt crowdsourcing for several reasons, such as concerns around the quality of content produced by students and the perceptions students may have of creating resources for their peers. While prior work has explored crowdsourcing concerns within the context of individual tools, lessons that are generalisable across multiple platforms and derived from practical use can provide considerably more robust insights. In this perspective article, we present four crowdsourcing tools that we have developed and used in computing classrooms. From our previous studies and experience, we derive lessons which shed new light on some of the concerns that are typical for instructors looking to adopt such tools. We find that across multiple contexts, students are capable of generating high quality learning content which provides good coverage of key concepts. Although students do appear hesitant to engage with new kinds of activities, various types of incentives have proven effective. Finally, although studies on learning effects have shown mixed results, no negative outcomes have been observed. In light of these lessons, we hope to see a greater uptake and use of crowdsourcing in computing education.INDEX TERMS contributing student pedagogy, crowdsourcing, crowdsourcing systems, learnersourcing

show abstract

Crowdsourcing in Computing Education Research: Case Amazon MTurk

Cited by 9 publications

References 31 publications

Measuring College Student Attitudes Toward COVID-19 Vaccinations

Measuring College Student Attitudes Toward COVID-19 Vaccinations

Measuring College Student Attitudes Toward COVID-19 Vaccinations

Lessons Learned From Four Computing Education Crowdsourcing Systems

Contact Info

Product

Resources

About