Motivating participation and improving quality of contribution in ubiquitous crowdsourcing

Gonçalves, Jorge; Hosio, Simo; Rogstadius, Jakob; Karapanos, Evangelos; Kostakos, Vassilis

doi:10.1016/j.comnet.2015.07.002

Cited by 53 publications

(39 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While situated crowdsourcing may be better suited for "local" tasks [27], it has also been shown to be effective with typical crowdsourcing tasks that can be seen in online labour markets [26]. While some situated crowdsourcing deployments do not track workers, making it impossible to assign task based on an individual's cognitive abilities [18,20,27], others have tracked individual workers, such as Bazaar, a situated crowdsourcing market that had user accounts, a virtual currency and rewards [26]. Here, as with online crowdsourcing platforms, having an initial cognitive assessment stage could be beneficial.…”

Section: Measuring Cognitive Abilities On Crowdsourcing Platformsmentioning

confidence: 99%

“…Here, as with online crowdsourcing platforms, having an initial cognitive assessment stage could be beneficial. A potential issue in this scenario is that workers may not be willing to undertake a long pre-requisite cognitive abilities test before being able to start completing crowdsourcing tasks due to the increased barrier for participation, which can significantly hinder uptake on situated crowdsourcing [16,18]. With that in mind, simplified versions of these tests could be constructed and validated, or workers could be financially rewarded for taking those tests.…”

Section: Measuring Cognitive Abilities On Crowdsourcing Platformsmentioning

confidence: 99%

See 1 more Smart Citation

Task Routing and Assignment in Crowdsourcing based on Cognitive Abilities

Gonçalves

Feldman

et al. 2017

Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion

Self Cite

View full text Add to dashboard Cite

Appropriate task routing and assignment is an important, but often overlooked, element in crowdsourcing research and practice. In this paper, we explore and evaluate a mechanism that can enable matching crowdsourcing tasks to suitable crowd-workers based on their cognitive abilities. We measure participants' visual and fluency cognitive abilities with the well-established Kit of FactorReferenced Cognitive Test, and measure crowdsourcing performance with our own set of developed tasks. Our results indicate that participants' cognitive abilities correlate well with their crowdsourcing performance. We also built two predictive models (beta and linear regression) for crowdsourcing task performance based on the performance on cognitive tests as explanatory variables. The model results suggest that it is feasible to predict crowdsourcing performance based on cognitive abilities. Finally, we discuss the benefits and challenges of leveraging workers' cognitive abilities to improve task routing and assignment in crowdsourcing environments.

show abstract

Section: Measuring Cognitive Abilities On Crowdsourcing Platformsmentioning

confidence: 99%

Section: Measuring Cognitive Abilities On Crowdsourcing Platformsmentioning

confidence: 99%

Task Routing and Assignment in Crowdsourcing based on Cognitive Abilities

Gonçalves

Feldman

et al. 2017

Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion

Self Cite

View full text Add to dashboard Cite

show abstract

“…To this end, recent work suggests that crowdsourcing using both situated and mobile technologies together with appropriately designed incentives can help in reaching large numbers of individuals both affordably and rapidly [6,8,9].…”

Section: Related Workmentioning

confidence: 99%

“…To this end, situated crowdsourcingreferring to either using fixed devices in the environment or using mobile devices in the correct spatiotemporal context [6] -has emerged as a promising means to collect high-quality data.…”

Section: The Studymentioning

confidence: 99%

Crowdsourcing situated & subjective knowledge for decision support

Hosio

Gonçalves

Berkel

et al. 2016

Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct

Self Cite

View full text Add to dashboard Cite

In this paper we present a study on crowdsourcing subjective knowledge. We introduce a mobile app that was built for this purpose, and compare results from two datasets collected using the app. One dataset was collected during a workshop and the other one during a one-week long field trial. We present interview findings on mobile knowledge collection. Further, we discuss the types of information that should optimally be collected on the go, and show how our data analysis supports the qualitative findings. This work directly continues our earlier efforts on creating a platform that encapsulates wisdom of the crowd for decision support.

show abstract

“…The literature documents well the related technological issues [8], [23], while only a few social studies help us to understand why and how urban mobile users get involved in MPS, such as for the collection of noise observations [11]. Indeed, most of such collaborative MPS systems faces a gap between: (1) the requirements of producing quantitative and qualitative data at scale, and (2) the limited deployment and use of the supporting mobile application (app for short).…”

Section: Introductionmentioning

confidence: 99%

Matching Technological & Societal Innovations: The Social Design of a Mobile Collaborative App for Urban Noise Monitoring

Lefevre

Issarny

2018

2018 IEEE International Conference on Smart Computing (SMARTCOMP)

View full text Add to dashboard Cite

Abstract-Mobile Phone Sensing offers a great opportunity toward the large scale monitoring of urban phenomena, such as the exposure of the population to environmental noise. Our research aims to make available a supporting mobile application together with the associated platform for the analysis of the contributed observations. The technological issues arising have been partly solved but a gap remains between the need for the massive collection of relevant data, and the quantity and accuracy of the measurements that are actually gathered. This paper presents our iterative research process to tackle this challenge, which combines technological innovation and social design. The presented research results contribute to a better understanding of why and how people use mobile phone sensing applications; the results also inform how to best leverage mobile crowd-sensing in the development of smart cities and how it may serve addressing urban challenges related to, e.g., public health or urban planning.

show abstract

Motivating participation and improving quality of contribution in ubiquitous crowdsourcing

Cited by 53 publications

References 41 publications

Task Routing and Assignment in Crowdsourcing based on Cognitive Abilities

Task Routing and Assignment in Crowdsourcing based on Cognitive Abilities

Crowdsourcing situated & subjective knowledge for decision support

Matching Technological & Societal Innovations: The Social Design of a Mobile Collaborative App for Urban Noise Monitoring

Contact Info

Product

Resources

About